Engineering Manager, Compiler & Runtime

Job Title

Engineering Manager, Compiler & Runtime

Role Summary

Lead and grow a compiler and runtime engineering team that takes PyTorch models to Normal's custom accelerator, delivers the runtime and kernels, and maintains software continuity from simulators and FPGA prototypes to silicon. This is a hands-on people-leadership role that plans and staffs the systems-software roadmap and partners with hardware and compiler architecture teams.

Experience Level

Senior - manager-level role focused on people leadership and technical delivery. Specific years of experience not stated.

Responsibilities

Own the compiler and runtime software stack and the team's delivery against the hardware program.

• Hire, develop, and mentor the compiler and runtime engineering team.
• Plan work, define milestones, and staff efforts to deliver compiler, runtime, and kernel features so LLMs run end-to-end on the hardware.
• Collaborate with the senior compiler architect to set technical direction and review designs.
• Coordinate closely with hardware (drivers/firmware), serving, and simulation teams.
• Maintain compatibility from simulation through FPGA prototypes to silicon to avoid software delays on tapeout.
• Establish testing, release, and code-review practices to ensure a reliable, shippable stack.

Requirements

Must-have skills and experience.

• Proven experience managing engineers who build compilers, runtimes, or kernels for accelerators or other non-standard hardware.
• Track record of hiring and mentoring strong systems engineers.
• Sufficient technical depth in compilers and runtimes to review designs and make trade-offs with senior engineers.
• Experience delivering software to a hardware schedule, from simulation through bring-up.
• Familiarity with modern ML compiler stacks and LLM inference workloads.

Nice-to-have:

• Built an accelerator software stack from zero to production at a startup or hardware initiative.
• Experience with in-memory compute, processing-in-memory, or analog hardware interfaces.
• Experience shipping an SDK or software product to external customers.

Education Requirements

Not specified.

About the Company

Company: Normal Computing

Headquarters: New York, NY, USA

Normal Computing develops software and hardware solutions for the semiconductor and AI infrastructure industries, specializing in ASICs for image and video diffusion inference and AI accelerators. The company focuses on architecture and microarchitecture of compute blocks, PE array design, ISA co-design, and FPGA prototyping.