Senior Software Engineer, Cloud-Native Stack – CSP Engagements

Job Title

Senior Software Engineer, Cloud-Native Stack – CSP Engagements

Role Summary

Join the CSP Engagements team to develop and validate cloud-native software for multi-rack, multi-tenant AI/ML datacenters using NVIDIA GB200/GB300-class GPUs. The role focuses on defining customer workflows, prototyping stack enhancements, and resolving complex Kubernetes and Slurm issues in production-scale environments.

Experience Level

Senior-level. Expected 10+ years of professional software development experience in distributed systems and cloud-native infrastructure.

Responsibilities

Work with customers and internal teams to diagnose, prototype, and deliver production-ready solutions for multi-rack, multi-tenant GPU datacenters.

• Perform deep-dive debugging of multi-rack, multi-tenant clusters: scheduler behavior, container runtime issues, device-plugin crashes, RDMA/InfiniBand fabric anomalies, and related failures.
• Gather customer requirements and prototype feature extensions for Kubernetes operators, Slurm plugins, and custom microservices to expose GPU capabilities.
• Lead architecture reviews and whiteboard sessions with CSP and platform teams; produce RFCs and upstream pull requests.
• Create reproducible testbeds using Helm, Ansible, and Terraform that mirror customer environments; automate validation and benchmarks.
• Produce technical collateral: design documents, how-to guides, demo scripts; present findings at customer sites and industry events.
• Collaborate with AE, FAE, and Solution Architect teams to deliver integrated customer solutions and documentation.

Requirements

Must-have technical skills and professional experience to perform the responsibilities above.

• Source-level expertise in Kubernetes internals (scheduler, CRI/CNI/CSI, operators) and strong practical experience with Slurm (federation, power-save, plugins).
• Hands-on experience integrating next-generation GPUs or comparable accelerators into containerized clusters and managing device plugins.
• Proven track record debugging large-scale cloud-native stacks across networking (RDMA/RoCE), storage, and control planes.
• Customer-facing engineering experience: requirements gathering, PoC ownership, and influencing roadmaps.
• Familiarity with CI/CD (GitHub Actions, Tekton), observability (Prometheus, OpenTelemetry), and infrastructure-as-code practices.
• Strong programming and tooling skills in one or more: Go, Rust, C/C++, or Python.
• Excellent written and verbal communication; able to shift between low-level technical detail and high-level business impact.
• 10+ years of professional software development experience in distributed systems.
• Nice-to-have: upstream contributions to Kubernetes/Slurm/Volcano, experience with CUDA and deep learning workloads, prior work with GB200/GB300-class GPUs.

Education Requirements

BS or MS (or equivalent practical experience) in Computer Science, Computer Engineering, or a related technical field.

About the Company

Company: NVIDIA

Headquarters: Santa Clara, California, USA

NVIDIA is a global leader in accelerated computing, renowned for its innovative solutions in AI and digital twins that transform diverse industries. The company specializes in networking technologies, providing end-to-end InfiniBand and Ethernet solutions for servers and storage that optimize performance and scalability. NVIDIA serves sectors such as high-performance computing, enterprise data centers, and cloud computing, constantly reinventing its products and services to stay ahead in the market.