Compiler Engineer - AI Inference
NVIDIAJob Title
Compiler Engineer - AI Inference
Role Summary
Join NVIDIA's compiler organization to develop high-performance compiler technology for AI inference and training on next-generation GPUs. The role focuses on kernel generation, computational-graph optimizations, and production-quality implementation that scales to datacenter deployments.
Base salary range: 152,000 USD - 241,500 USD. Eligible for equity and benefits. Applications accepted at least until 2026-08-22.
Experience Level
Mid-level — typically requires 3+ years of relevant industry experience in compiler optimizations or related areas.
Responsibilities
Key responsibilities include hands-on development and collaboration to advance compiler capabilities for AI workloads.
- Develop kernel generation and computational-graph optimizations for NVIDIA GPUs.
- Solve complex compilation problems for inference and training and transition solutions into products.
- Collaborate with hardware, software, and research teams on hardware/software co-design and future silicon architecture.
- Optimize and scale AI workloads for datacenter deployments.
Requirements
Must-have technical skills and experience.
- 3+ years of industry experience specializing in compiler optimizations, synthesis, and placement.
- Practical, hands-on experience with MLIR.
- Strong C/C++ and Python programming skills; experience with debugging, performance analysis, and test design.
- Effective communication and collaboration skills in fast-paced, product-oriented teams.
Nice-to-have:
- Experience implementing complex AI workloads on CPU, GPU, or custom AI accelerators.
- Deep understanding of LLM inference and implications for computer architecture.
- Experience designing and architecting comprehensive compiler frameworks.
Education Requirements
BS or MS in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience. PhD is strongly preferred.
About the Company
Company: NVIDIA
Headquarters: Santa Clara, California, USA
NVIDIA is a global leader in accelerated computing, renowned for its innovative solutions in AI and digital twins that transform diverse industries. The company specializes in networking technologies, providing end-to-end InfiniBand and Ethernet solutions for servers and storage that optimize performance and scalability. NVIDIA serves sectors such as high-performance computing, enterprise data centers, and cloud computing, constantly reinventing its products and services to stay ahead in the market.
