Compiler Engineer - AI Inference
NVIDIAJob Title
Compiler Engineer - AI Inference
Role Summary
Develop compiler technology for AI inference and training targeting next-generation NVIDIA GPUs. The role focuses on kernel generation, computational graph optimizations, performance tuning, and shipping compiler features into production.
Work within a cross-functional team on hardware/software co-design to scale AI workloads for datacenter and consumer products.
Experience Level
Mid-level — typically 3+ years of relevant industry experience in compiler development or related fields.
Responsibilities
Key responsibilities include:
- Develop and optimize kernel generation and computational graph transformations for NVIDIA GPUs.
- Solve complex compilation problems for AI inference and training and integrate solutions into products.
- Collaborate with hardware, software, and research teams on hardware/software co-design and future silicon architecture.
- Optimize and scale datacenter AI workload deployments.
- Perform debugging, performance analysis, and design tests to validate compiler changes.
Requirements
Must-have technical skills and experience:
- 3+ years industry experience specializing in compiler optimizations, code generation, or related compiler systems.
- Hands-on experience with MLIR.
- Strong software engineering skills in C/C++ and Python, including debugging and performance analysis.
- Effective communication and collaboration skills in a fast-paced, product-focused environment.
Nice-to-have:
- Experience implementing complex AI workloads on CPU, GPU, or custom AI accelerators.
- Deep understanding of LLM inference and its implications on computer architecture.
- Experience designing or architecting comprehensive compiler frameworks.
Education Requirements
Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field; PhD is strongly preferred. Equivalent practical experience accepted.
About the Company
Company: NVIDIA
Headquarters: Santa Clara, California, USA
NVIDIA is a global leader in accelerated computing, renowned for its innovative solutions in AI and digital twins that transform diverse industries. The company specializes in networking technologies, providing end-to-end InfiniBand and Ethernet solutions for servers and storage that optimize performance and scalability. NVIDIA serves sectors such as high-performance computing, enterprise data centers, and cloud computing, constantly reinventing its products and services to stay ahead in the market.
