Staff Machine Learning Framework/Runtime Software Engineer
ArmJob Title
Staff Machine Learning Framework/Runtime Software Engineer
Role Summary
Senior engineer responsible for designing, developing, integrating, testing, and optimising machine-learning framework and runtime components to enable efficient AI inference on Arm platforms. The role sits at the intersection of frameworks, runtimes, compilers, drivers and hardware teams.
Work focuses on backend integration, performance optimisation and resolving complex functional or performance issues across the AI software stack.
Experience Level
Senior. The posting implies an experienced, senior-level engineer; no explicit years of experience were specified.
Responsibilities
Core responsibilities include engineering and cross-team collaboration to deliver production-quality runtime and framework solutions.
- Design, implement and optimise C++ components in large, modular codebases for ML runtimes and inference engines.
- Integrate backends via delegates, execution providers, plugins or similar mechanisms.
- Diagnose, investigate and resolve complex functional and performance issues across frameworks, runtimes, compilers, drivers and hardware abstraction layers.
- Collaborate with compiler, driver and hardware teams to deliver end-to-end solutions for AI acceleration.
- Develop and maintain automated tests, benchmarking, profiling and CI/CD workflows for runtime validation.
- Drive performance optimisation, memory planning, operator execution and graph processing improvements.
Requirements
Must-have technical skills and practical experience required for the role, followed by concise nice-to-have items.
- Must-have: Strong C++ software development experience, ideally in inference engines, runtime systems or backend integration frameworks.
- Experience with a machine-learning inference framework such as TensorFlow Lite, ONNX Runtime, LiteRT, or similar.
- Practical understanding of AI model execution: graph processing, operator execution, memory management and backend integration.
- Demonstrated ability to analyse and resolve complex functional or performance issues across multiple software and hardware layers.
- Strong analytical and problem-solving skills and experience working across multidisciplinary engineering teams.
- Nice-to-have: Experience developing delegates/execution providers/plugins, GPU programming (Vulkan, OpenCL), AOT/JIT compilation flows, graph transforms, operator partitioning, scheduling or model optimisation.
- Experience with benchmarking, profiling, compiler technologies, intermediate representations, hardware abstraction layers, or building CI/CD for large-scale projects.
Education Requirements
Not specified.
About the Company
Company: Arm
Headquarters: Cambridge, United Kingdom
ARM is a global leader in semiconductor and software design, driving innovation in computing technology. The company specializes in designing processors and systems that provide the essential building blocks for electronic devices. ARM's architecture is widely used in smartphones, servers, and IoT devices, and its collaborative culture fosters bold thinking, diversity, and high-impact benefits for its talented workforce.
