Microsoft logo

Principal ML Architect

Microsoft
June 02, 2026
Full-time
Remote friendly (Mountain View, California, United States)
Worldwide
$142,800 - $274,800 USD yearly
SoC Architecture Jobs, Level - Senior

Job Title

Principal ML Architect

Role Summary

Join Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) to define and deliver AI silicon architecture and operational measures for cloud hardware. The role focuses on designing and evaluating accelerator architectures, building bit-accurate models and test platforms, and supporting silicon development through collaboration with hardware and software teams.

Experience Level

Senior β€” principal-level individual contributor. The posting describes senior experience expectations (multi-year technical engineering experience; see Education Requirements for degree/experience equivalencies).

Responsibilities

Key responsibilities center on architecture exploration, modeling, and cross-team support during silicon development.

  • Explore algorithms and microarchitecture for AI silicon accelerators.
  • Develop bit-accurate C models and associated test platforms.
  • Write hardware architecture exploration models to drive architecture studies.
  • Collaborate with hardware and software architecture teams across design, verification, emulation, and software stacks.
  • Support design, DV, emulation, and kernel development teams throughout the silicon development cycle.

Requirements

Must-have technical skills and workplace requirements; education details summarized separately below.

  • Proven experience in architecture modeling and analysis across levels of abstraction.
  • Strong C/C++ coding skills and experience developing bit-accurate models or simulators.
  • Experience with hardware/software co-design and familiarity with RTL, DV, and emulation workflows.
  • Knowledge of ML algorithms, linear algebra, and accelerator-relevant computation patterns.
  • Ability to pass Microsoft Cloud background checks and satisfy export-control information access requirements.
  • Excellent communication skills and ability to work across cross-functional engineering teams.

Education Requirements

Doctorate (PhD) in Electrical Engineering, Computer Engineering, Computer Science, or related field plus 3+ years technical engineering experience; OR Master's degree in those fields plus 6+ years experience; OR Bachelor's degree in those fields plus 8+ years experience; OR equivalent practical experience.


About the Company

Company: Microsoft

Headquarters: Redmond, Washington, United States

Microsoft is a global technology company that develops and sells software, services, devices, and solutions. Known for its Windows operating system, Office suite, and Azure cloud platform, Microsoft aims to empower individuals and organizations around the world to achieve more. The company fosters a culture of innovation and inclusion, focusing on delivering trusted experiences to customers and partners globally.

Microsoft logo

Date Posted: 2026-06-02