AI/ML Software Engineer

Job Title

AI/ML Software Engineer

Role Summary

Join SiFive's AI/ML Software team to build the software stack for next‑generation AI on RISC‑V. The role focuses on optimizing and deploying LLMs and generative models across compiler infrastructure, runtime systems, and model distribution for high‑throughput inference and training.

Experience Level

Mid-level

Responsibilities

Key responsibilities include:

• Develop and maintain MLIR/IREE/Triton compiler stacks and optimize end‑to‑end LLM performance; contribute to relevant open‑source projects.
• Design and implement single‑ and multi‑device scheduling and memory management layers; define hardware–software interfaces for AI workloads.
• Implement model sharding and distribution strategies and integrate high‑level frameworks (for example, PyTorch) with hardware backends.
• Analyze and profile models to identify bottlenecks; develop high‑performance kernels leveraging RISC‑V Vector (RVV) and ISA extensions.
• Collaborate with hardware architects on accelerator and microarchitecture co‑design.

Requirements

Must-have technical skills and experience:

• Programming: Strong proficiency in C++ and Python.
• Domain expertise: Solid understanding of AI/ML models (LLMs, diffusion models, Transformers) and deployment challenges.
• Systems/Compilers: Experience with one or more compiler frameworks (MLIR, IREE, LLVM, Triton), system programming, memory management, or multi‑device orchestration.
• Distributed: Knowledge of distributed computing, model parallelism, or tensor sharding.

Nice-to-have:

• Experience with PyTorch, ONNX Runtime, or TensorFlow/TFLite.
• Familiarity with distributed training/inference, collective communications, or MLPerf benchmarking.
• Active contributions to open‑source AI/ML or compiler projects; low‑level performance tuning experience.

Education Requirements

Master's or PhD in Computer Science, Applied Mathematics, or a related technical field.

About the Company

Company: SiFive

Headquarters: San Mateo, California, United States

SiFive is a pioneering company in the RISC-V ecosystem, focused on transforming the future of computing by delivering high-performance, data-intensive RISC-V solutions. Their compute platforms empower leading technology firms to innovate across various markets, including AI, machine learning, and automotive sectors. SiFive is recognized for its commitment to ongoing innovation and fostering collaboration among talented teams, impacting lives by enabling advanced chip design.