Senior System Software Engineer

Job Title

Senior System Software Engineer

Role Summary

Develop and optimize an AI inference runtime and related system software for embedded Linux devices, focusing on efficient execution of large and multi-modal models on Ambarella-class hardware. Deploy, debug, and tune models on board-side devices and collaborate with algorithm and hardware teams to deliver production-ready solutions.

Experience Level

Senior-level.

Responsibilities

Primary responsibilities include development, optimization, deployment, and cross-team collaboration.

• Design and implement an AI inference runtime library for embedded Linux in C/C++, supporting large and multi-modal models.
• Implement and optimize AI operators for Ambarella-like hardware to improve model runtime performance.
• Deploy, integrate, debug, and profile AI models on board-side devices; optimize memory, bandwidth, and I/O usage.
• Perform Linux system-level debugging and performance tuning (memory, CPU, I/O, concurrency).
• Contribute to the design and development of a distributed large-model inference framework.
• Collaborate with algorithm and hardware teams and produce technical documentation.

Requirements

Key qualifications and skills.

• Must-have: Proficient in C/C++ with solid engineering fundamentals (memory management, pointers, multithreaded programming).
• Must-have: Experience with Linux system programming (processes/threads, synchronization mechanisms, network programming).
• Must-have: Familiarity with at least one ML framework such as TensorFlow, ONNX, or PyTorch.
• Nice-to-have: Understanding of LLM/VLM algorithms and common optimization methods.
• Nice-to-have: Experience with Ray, Transformers, vLLM, or related large-model tooling.
• Must-have: Strong independent analysis, problem-solving, communication, and teamwork skills.

Education Requirements

Not specified.

About the Company

Company: Ambarella

Headquarters: Santa Clara, California, USA

Ambarella is a leader in computer vision and video processing technology, providing advanced solutions that enhance the performance of video applications. Focused on quality and innovation, Ambarella develops products for diverse uses, including autonomous vehicles, surveillance systems, and smart cameras, aiming to deliver pristine imagery and efficient compression while minimizing power consumption.