Principal AI Performance Engineer
ArmJob Title
Principal AI Performance Engineer
Role Summary
Work with customers to optimize AI inference workloads on Arm technology, delivering kernel-to-system performance and power-efficiency improvements. Based in San Jose with significant customer engagement across the Bay Area, and collaborating with multiple Arm engineering teams to diagnose performance issues and influence IP and tooling roadmaps.
Experience Level
Senior-level (Principal). Years of experience not specified.
Responsibilities
Primary responsibilities include:
- Develop highly optimized solutions for AI workloads, from kernel-level implementations to system-level integration, to meet customer application requirements.
- Create production-quality reference implementations, technical documentation, and performance-focused content.
- Act as a technical bridge between customers and internal teams; drive resolution of complex performance issues.
- Use customer-derived insights to influence Arm IP and software tooling roadmaps.
Requirements
Must-have skills and experience:
- Experience optimizing DNNs at the kernel level (e.g., Triton, CUDA, or similar).
- Deep understanding of parallel computing, memory hierarchies, and DNN performance optimization techniques.
- Strong programming skills in Python and C++; familiarity with modern AI frameworks and execution models.
- Experience with profiling and analysis tools.
- Strong communication and interpersonal skills; able to present technical findings to both engineers and senior leadership.
- Must have the right to work in the United States without sponsorship.
Nice-to-have:
- Customer-facing or field engineering experience.
- Experience within the Arm ecosystem.
- Background in AI performance optimization for edge devices.
Education Requirements
Not specified.
About the Company
Company: Arm
Headquarters: Cambridge, United Kingdom
ARM is a global leader in semiconductor and software design, driving innovation in computing technology. The company specializes in designing processors and systems that provide the essential building blocks for electronic devices. ARM's architecture is widely used in smartphones, servers, and IoT devices, and its collaborative culture fosters bold thinking, diversity, and high-impact benefits for its talented workforce.
