GPU Compiler Intern
NVIDIAJob Title
GPU Compiler Intern
Role Summary
The intern will develop compiler infrastructure for Python-based GPU programming, working on DSL design, MLIR IR design, and compiler optimizations to translate Python programs into high-performance NVIDIA GPU kernels.
Work is focused on CUTLASS CuTeDSL and related compiler toolchains to enable efficient kernel generation and performance tuning.
Experience Level
Entry-level internship. Intended for students or early-career candidates; no specific years of professional experience required.
Responsibilities
Core responsibilities include:
- Design and implement Python DSL features for GPU kernel authoring, including metaprogramming and IR generation.
- Develop MLIR dialects, transformation passes, and lowering pipelines that preserve information for GPU optimization.
- Design and optimize GPU kernels and evaluate how IR design and compiler transformations affect generated code and performance.
- Profile, benchmark, and validate compiler and kernel improvements across representative workloads.
Requirements
Must-have technical skills (formal education listed separately under Education Requirements):
- Proficiency in Python and C++, with strong debugging and software development skills.
- Understanding of Python DSLs, including metaprogramming, staged execution, and translation into compiler IR.
- Experience with MLIR: IR construction, transformation passes, or lowering.
- Practical GPU programming experience, preferably CUDA; knowledge of GPU execution and memory models.
- Familiarity with performance analysis and optimization (profiling, memory access patterns, parallel execution).
- Nice-to-have: experience with CUTLASS, CuTeDSL, Triton, LLVM, or other GPU compiler and kernel development tools.
Education Requirements
Currently pursuing or holding a Bachelor’s, Master’s, or Ph.D. degree in Computer Science, Computer Engineering, or a related technical discipline, or equivalent practical experience.
About the Company
Company: NVIDIA
Headquarters: Santa Clara, California, USA
NVIDIA is a global leader in accelerated computing, renowned for its innovative solutions in AI and digital twins that transform diverse industries. The company specializes in networking technologies, providing end-to-end InfiniBand and Ethernet solutions for servers and storage that optimize performance and scalability. NVIDIA serves sectors such as high-performance computing, enterprise data centers, and cloud computing, constantly reinventing its products and services to stay ahead in the market.
