Senior AI Training Performance Architect
NVIDIAJob Title
Senior AI Training Performance Architect
Role Summary
Senior engineer focused on analyzing and optimizing AI training workloads across hardware and software layers to maximize GPU training performance and influence hardware/software roadmaps.
Team responsibilities include performance analysis, driver/framework development, simulator-based architecture studies, and benchmark submissions.
Experience Level
Senior-level; typically 5+ years relevant experience. See Education Requirements for degree-specific experience guidance.
Responsibilities
Work across hardware and software stacks to improve AI training performance and enable future architecture decisions.
- Profile, analyze, and optimize AI training workloads on modern GPUs and systems.
- Identify and prioritize performance bottlenecks across the stack and implement solutions.
- Implement production-quality software spanning drivers, libraries, and deep-learning frameworks.
- Build and maintain MLPerf Training submissions and benchmarking infrastructure.
- Implement key training workloads in processor and system simulators for architecture studies.
- Develop tools and automation for workload analysis, optimization, and related workflows.
Requirements
Core technical skills and proven experience required.
- Strong background in deep learning and neural network training workloads.
- Solid understanding of computer architecture and GPU architecture fundamentals.
- Proven experience analyzing and tuning application and system performance.
- Experience with processor- and system-level performance modeling.
- Proficiency in C++, Python, and CUDA.
- Ability to deliver production-quality code and collaborate across engineering teams.
- Nice-to-have: experience with MLPerf, GPU driver internals, deep-learning framework internals, and system/processor simulators.
Education Requirements
PhD in Computer Science, Electrical Engineering, or Computer Engineering (CSEE) with 5+ years of relevant experience; or MS with 8+ years of relevant experience; or equivalent practical experience.
About the Company
Company: NVIDIA
Headquarters: Santa Clara, California, USA
NVIDIA is a global leader in accelerated computing, renowned for its innovative solutions in AI and digital twins that transform diverse industries. The company specializes in networking technologies, providing end-to-end InfiniBand and Ethernet solutions for servers and storage that optimize performance and scalability. NVIDIA serves sectors such as high-performance computing, enterprise data centers, and cloud computing, constantly reinventing its products and services to stay ahead in the market.
