Senior Staff Software Machine Learning Test Engineer

Job Title

Senior Staff Software Machine Learning Test Engineer

Role Summary

Join the Software QA team to develop and scale test automation and infrastructure for d-Matrix's AI compute engine and software stack. The role focuses on component and end-to-end qualification, LLM accuracy/benchmarking, and test framework development for next-generation AI hardware.

Experience Level

Senior level; the posting requests 7+ years of industry experience.

Responsibilities

The primary responsibilities are test automation, infrastructure maintenance, and cross-team qualification for ML software and hardware.

• Design, implement, and maintain automated tests and test frameworks for ML software stacks and hardware products.
• Develop LLM accuracy, benchmarking, and robustness tests and automation.
• Use and extend Pytest-based frameworks and GitLab CI/CD for component and end-to-end qualification.
• Collaborate with ML kernel, compiler, runtime, hardware architecture, and model research teams during qualification.
• Maintain and improve test infrastructure to support scaling and productization of the software stack.

Requirements

Core technical skills and experience required; desirable skills listed separately.

• Must-have: 7+ years of industry experience in software test engineering focused on ML or related systems.
• Must-have: Strong Python programming and data-structure skills; experience in Linux environments.
• Must-have: Experience building and scaling test frameworks and automation for software/hardware qualification.
• Must-have: Familiarity with large language models and machine learning fundamentals.
• Must-have: Experience with Pytest and CI/CD systems (experience with GitLab CI/CD preferred).
• Nice-to-have: Experience testing deep learning frameworks (TensorFlow, PyTorch), Transformers, and model-layer validation.
• Nice-to-have: Prior startup or small-team experience and exposure to ML model benchmarking and robustness testing.
• Strong communication and ability to work across global engineering and research teams.

Education Requirements

Bachelor's or master's degree in Computer Science, Electrical Engineering, or a related field is requested; the posting also allows equivalent industry experience (explicitly lists 7+ years of industry experience).

About the Company

Company: d-Matrix

Headquarters: Santa Clara, California, United States

d-Matrix is a Santa Clara–based startup developing highly programmable in-memory computing architectures and accompanying software to accelerate generative AI and other AI workloads, focusing on hardware-software co-design for cloud and edge applications.