Developer Experience / DevEx
FractileJob Title
Developer Experience (DevEx)
Role Summary
The Developer Experience engineer builds developer-facing tooling, observability, and documentation that help customers and internal engineers use Fractile's inference accelerator effectively. The role sits within the Software organisation and focuses on making performance analysis and optimisation accessible to LLM engineers.
Work involves identifying optimization opportunities across the stack, delivering low-friction tools that fit existing ML workflows, and collaborating with compiler, firmware, runtime and hardware teams.
Experience Level
Mid-level. The posting does not state explicit years of experience; candidates should have prior experience working on inference tooling or at inference service providers.
Responsibilities
Primary responsibilities include:
- Design and implement developer-facing tools and integrations for LLM engineers.
- Collect, analyse, and present system usage and performance data to identify optimization opportunities.
- Profile and optimise model deployments and accelerator code paths.
- Collaborate with compiler, firmware, runtime, and hardware teams to deliver end-to-end solutions.
- Ensure tools integrate into existing ML workflows with minimal disruption and a shallow learning curve.
- Work with stakeholders across multiple teams to prioritise and deliver features.
Requirements
Must-have technical skills and experience:
- Experience with inference frameworks such as JAX and/or PyTorch.
- Software development experience in Python, Rust, C, or C++.
- Experience monitoring and optimising accelerator/GPU code (CUDA, ROCm, OpenCL, or similar).
- Experience monitoring and optimising LLM deployments with models around 50B+ parameters.
- Proven ability to collaborate with stakeholders across multiple teams and deliver practical tooling.
- Self-driven, with a track record of identifying tooling opportunities and delivering solutions; prior FDE or inference-service experience is desirable.
Nice-to-have:
- Experience with ML compilers, device drivers, systems firmware, simulators, or datacenter-scale deployment tooling.
Education Requirements
Not specified.
About the Company
Company: Fractile
Headquarters: London, UK
Fractile is on a mission to revolutionize AI by developing silicon, systems, and software that enable the fastest execution of advanced models at lower costs. Established in 2022, the company has rapidly expanded, fostering a collaborative culture in its London and Bristol offices. With a focus on innovation in ML/AI IC product development, Fractile combines hardware and software to deliver high-impact solutions for data center applications.
