Senior AI Training Performance Engineer

Job Title

Senior AI Training Performance Engineer

Role Summary

Analyze and optimize AI training performance across the hardware and software stack, focusing on GPU-based systems and deep learning frameworks. Join the Deep Learning Architecture team to influence hardware and software roadmaps that improve training throughput and efficiency.

Experience Level

Senior — expects senior-level experience. Typical guidance: PhD (or equivalent experience) with 5+ years, or MS with 8+ years of relevant experience.

Responsibilities

Primary duties include profiling, diagnosing, and improving training workloads; implementing production-quality code; and building tools and simulations to inform architecture decisions.

• Profile and optimize AI/deep learning training workloads on state-of-the-art hardware and software platforms.
• Identify, prioritize, and resolve performance bottlenecks across many neural network models.
• Develop production-quality software across multiple layers (drivers, libraries, and DL frameworks).
• Implement key training workloads in processor and system simulators for architecture studies.
• Build automation tools to support workload analysis and optimization workflows.

Requirements

Must-have technical skills and experience.

• Strong background in deep learning and neural network training.
• Deep understanding of computer architecture and familiarity with GPU fundamentals.
• Proven experience analyzing and tuning application performance.
• Experience with processor- and system-level performance modeling.
• Programming skills in C++, Python, and CUDA.
• Fluency in English.

Education Requirements

PhD in Computer Science, Electrical Engineering, or CSEE (or equivalent practical experience) with 5+ years; or MS with 8+ years of relevant work experience. Equivalent practical experience accepted where stated.

About the Company

Company: NVIDIA

Headquarters: Santa Clara, California, USA

NVIDIA is a global leader in accelerated computing, renowned for its innovative solutions in AI and digital twins that transform diverse industries. The company specializes in networking technologies, providing end-to-end InfiniBand and Ethernet solutions for servers and storage that optimize performance and scalability. NVIDIA serves sectors such as high-performance computing, enterprise data centers, and cloud computing, constantly reinventing its products and services to stay ahead in the market.