Senior Principal AI Performance Engineer
ArmJob Title
Senior Principal AI Performance Engineer
Role Summary
As a Senior Principal AI Performance Engineer you will work with customers to optimize inference performance and power efficiency for AI models running on Arm technology. The role focuses on kernel- and system-level performance improvements and influencing Arm IP and tooling based on real-world customer feedback.
Position is based in San Jose with significant customer-facing work across the Bay Area; expects hybrid work between office and field engagements.
Experience Level
Senior-level (Senior Principal). Years of experience not specified.
Responsibilities
Key responsibilities include:
- Develop highly optimized kernel- and system-level implementations for DNNs to meet customer performance and power goals.
- Create production-quality reference implementations, documentation, and performance-focused technical content.
- Profile, diagnose and resolve complex performance and power issues across hardware and software stacks.
- Collaborate with customers, cross-functional engineering teams, and product teams to drive issue resolution and roadmap influence.
- Present technical findings and recommendations to engineering audiences and senior leadership.
Requirements
Must-have skills and experience:
- Experience optimizing DNNs at the kernel level (e.g., Triton, CUDA, or equivalent).
- Deep understanding of parallel computing, memory hierarchies, and performance optimization techniques for DNNs.
- Strong programming skills in Python and C++ and experience with modern AI frameworks and execution models.
- Experience with profiling and analysis tools for performance tuning.
- Strong written and verbal communication skills for customer-facing work.
Nice-to-have:
- Field or customer-facing engineering experience.
- Experience within the Arm ecosystem.
- Background in AI performance optimization for edge devices.
Education Requirements
Not specified.
About the Company
Company: Arm
Headquarters: Cambridge, United Kingdom
ARM is a global leader in semiconductor and software design, driving innovation in computing technology. The company specializes in designing processors and systems that provide the essential building blocks for electronic devices. ARM's architecture is widely used in smartphones, servers, and IoT devices, and its collaborative culture fosters bold thinking, diversity, and high-impact benefits for its talented workforce.
