Product Manager, AI Infrastructure

Job Title

Product Manager, AI Infrastructure

Role Summary

Join Arm's Cloud AI product management team to define and deliver production AI compute platforms that integrate hardware, software, and services. The role focuses on system-level product definition, technical tradeoffs, and driving cross-functional decisions to meet customer and deployment requirements.

The team works on datacenter AI/ML infrastructure and partners with engineering, customers, and deployment teams to deliver production-ready systems.

Experience Level

Mid-level — requires 6+ years of relevant experience in product management, systems or solution engineering, or related product leadership roles.

Responsibilities

Primary responsibilities include defining the product, owning system integration, and resolving cross-component gaps to enable production AI workloads.

• Define AI compute product scope: supported workloads, system capabilities, and constraints.
• Own system integration to ensure hardware, software, and services form a production-ready platform.
• Identify and resolve gaps across hardware, software, and deployment (performance, behavior, capacity).
• Drive multi-functional decisions when components, timelines, or priorities conflict.
• Translate customer and technical constraints into clear tradeoffs and priorities for engineering teams.

Requirements

Must-have skills and experience required to perform the role.

• Proven experience delivering complex, multi-component compute systems that include both hardware and software.
• Strong systems thinking and ability to reason across layer boundaries and end-to-end system behavior.
• Proven ability to drive ambiguous, multi-functional problems to resolution and make product tradeoffs across competing constraints.
• Solid understanding of datacenter AI infrastructure: compute, memory, networking, software, and services.
• 6+ years of experience in product management, systems or solution engineering, or a related product leadership role.

Nice-to-have

• Experience with data center compute deployment at scale, including service readiness, fleet rollout, or capacity planning for AI compute.
• Experience working with ML accelerators.
• Hands-on experience building or running GenAI workloads at scale.
• Experience with real-world hardware-software codesign (accelerators, distributed systems, or large-scale cloud services).

Education Requirements

Bachelor's degree in Electrical or Computer Engineering or equivalent practical experience is expected. Master's or PhD in Electrical or Computer Engineering is preferred but not required.

About the Company

Company: Arm

Headquarters: Cambridge, United Kingdom

ARM is a global leader in semiconductor and software design, driving innovation in computing technology. The company specializes in designing processors and systems that provide the essential building blocks for electronic devices. ARM's architecture is widely used in smartphones, servers, and IoT devices, and its collaborative culture fosters bold thinking, diversity, and high-impact benefits for its talented workforce.