Tools Developer (Rust / Linux)
FractileJob Title
Tools Developer (Rust / Linux)
Role Summary
The Tools Developer will join the Developer Experience team to build developer-facing tooling and observability for Fractile's AI inference accelerator. You will design and deliver low-friction tools that help LLM engineers profile, monitor, and optimise large-model deployments.
You will work across software, hardware and systems teams to identify tooling needs, implement solutions (primarily for Linux environments), and ensure those tools integrate smoothly with common ML workflows.
Experience Level
Mid-level. The posting does not specify exact years of experience.
Responsibilities
Primary responsibilities focus on creating practical developer tools and performance tooling for inference systems:
- Design, implement and maintain developer-facing tooling and performance analysis utilities for Linux-based environments.
- Integrate tools with ML frameworks (e.g., JAX, PyTorch) and engineers' existing workflows.
- Profile and optimise codepaths, including GPU/accelerator kernels written for CUDA, ROCm, OpenCL or similar.
- Build observability, telemetry, and reporting features to surface performance bottlenecks for large LLM deployments.
- Collaborate with stakeholders across hardware, firmware, runtime and ML teams to prioritise and deliver tooling improvements.
- Document tools and provide straightforward UX so engineers can adopt them with minimal disruption.
Requirements
Must-have technical skills and behaviours:
- Experience with inference frameworks such as JAX and/or PyTorch.
- Software development experience in Python, Rust, C/C++ or a similar systems language.
- Experience monitoring and optimising code written for accelerators (CUDA, ROCm, OpenCL or similar).
- Experience monitoring and optimising LLM deployments with 50+ billion parameters.
- Proven ability to work with stakeholders across multiple teams and communicate technical findings clearly.
- Self-driven, capable of scoping, designing and delivering developer tools that fit into existing workflows.
Nice-to-have:
- Prior role as a Field Developer Engineer (FDE) or experience at a company that provides inference services with in-house models.
- Experience with Linux system-level tooling, simulators, or ML compiler/runtime internals.
Note: Some roles may require eligibility checks for UK, US or other export control regulations.
Education Requirements
Not specified.
About the Company
Company: Fractile
Headquarters: London, UK
Fractile is on a mission to revolutionize AI by developing silicon, systems, and software that enable the fastest execution of advanced models at lower costs. Established in 2022, the company has rapidly expanded, fostering a collaborative culture in its London and Bristol offices. With a focus on innovation in ML/AI IC product development, Fractile combines hardware and software to deliver high-impact solutions for data center applications.
