Senior System Software Engineer, DGX Cloud AI Infrastructure
Lead design, build, launch, and operation of AI infrastructure services, tools, and open-source projects for NVIDIA’s DGX Cloud team.
- Santa Clara, California, United States
- Full-time
- $224K–$431K per year
- Posted Nov 6, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Drive the design, build, launch and operation of our services, tools and open-source projects.
- Plan and assign the team’s work, mentor junior engineers and review designs.
- Build resilient AI infrastructure on Kubernetes and Slurm for NVIDIA’s own training workloads and customer workloads.
- Build APIs that connect to NVIDIA’s resiliency systems: telemetry, break/fix automation, and checkpoint and execution systems.
- Build a job submission layer that hides infrastructure failures from users and restarts long-running training jobs automatically.
- Build agentic tools that help customers improve training efficiency by finding bottlenecks, diagnosing failures and recommending fixes.
- Drive our open-source work. Release components so customers and the community can use them, and work with them to improve those components.
- Set up how the team runs its services: support, monitoring, alerts, CI/CD, integration test gates and on-call plans.
Requirements
- BS, MS or PhD in Computer Science or a related field (or equivalent experience)
- Experience in a ML infrastructure
Skills
KubernetesSlurmPyTorchTensorFlowJAXRayNVIDIA GPUsnetworkingCI/CDmonitoringalertingon-callfault tolerancecheckpointingLLM-based agentsKubernetesSlurmPyTorchTensorFlowJAXRayCI/CDmonitoringalerting
Benefits
- equity and benefits
More jobs nearby
Full description
Company details are for members
Sign up for a free job alert to see NVIDIA's profile, website and LinkedIn, and the same for every employer on Referso Jobs.