Senior Software Engineer — Kernels

Job Title

Senior Software Engineer — Kernels

Role Summary

Develop and optimize software kernels and toolchain components for an AI compute engine. Collaborate with compiler, ML, systems, and hardware teams to map computational graphs and algorithms to specialized hardware and ship production-ready software.

Hybrid role with onsite presence in Bangalore 3–5 days per week.

Experience Level

Senior-level. Typical background: MS + 5+ years industry experience, or PhD + 1+ years; equivalent practical experience may be considered.

Responsibilities

Deliver production-quality kernel implementations and contribute to the full-stack software toolchain for next-generation AI hardware.

• Design, implement, and optimize kernels for ML operators (GEMM, convolutions, BLAS, softmax, layer norm, pooling).
• Map computational graphs from ML frameworks to target hardware and optimize performance/resource trade-offs.
• Collaborate with compiler, ML, systems, and hardware engineers to build compiler infrastructure and integrations.
• Implement and optimize algorithms in C/C++ and Python for specialized hardware (DSPs, GPUs, AI accelerators, FPGAs).
• Profile, benchmark, and tune kernels for performance, memory, and power constraints.
• Produce maintainable, testable, and scalable software deliverables within tight timelines.

Requirements

Must-have technical skills and experience.

• Strong knowledge of computer architecture, data structures, system software, and machine learning fundamentals.
• Proficient in C/C++ and Python development on Linux with standard development tooling.
• Experience implementing algorithms for specialized hardware (FPGAs, DSPs, GPUs, AI accelerators) and using libraries such as CUDA.
• Experience implementing ML operators and SIMD-based optimizations for embedded vector processors (e.g., Tensilica).
• Experience across the full-stack toolchain and hardware–software co-design trade-offs.
• Self-motivated, ownership-focused team player with leadership capabilities.

Nice-to-have:

• Startup or small-team experience.
• Experience with ML frameworks (TensorFlow, PyTorch) and ML compilers/IRs (MLIR, LLVM, TVM, Glow).
• Experience with ML models for CV, NLP, or recommendation systems and prior work at cloud or AI compute companies.

Education Requirements

MS in computer engineering, mathematics, physics, or a related field with 5+ years industry experience, OR PhD in the same fields with 1+ years industry experience. Equivalent practical experience may be considered.

About the Company

Company: d-Matrix

Headquarters: Santa Clara, California, United States

d-Matrix is a Santa Clara–based startup developing highly programmable in-memory computing architectures and accompanying software to accelerate generative AI and other AI workloads, focusing on hardware-software co-design for cloud and edge applications.