Senior System Software Engineer, DGX Cloud AI Infrastructure
Lead design, build, launch, and operate AI infrastructure services, tools, and open‑source projects for NVIDIA’s DGX Cloud team.
- Santa Clara, California, United States
- Full-time
- $224K–$431K per year
- Posted Nov 6, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Drive the design, build, launch and operation of services, tools and open‑source projects
- Plan and assign the team’s work, mentor junior engineers and review designs
- Build resilient AI infrastructure on Kubernetes and Slurm for NVIDIA’s own training workloads and customer workloads
- Build APIs that connect to NVIDIA’s resiliency systems: telemetry, break/fix automation, and checkpoint and execution systems
- Build a job submission layer that hides infrastructure failures from users and restarts long-running training jobs automatically
- Build agentic tools that help customers improve training efficiency by finding bottlenecks, diagnosing failures and recommending fixes
- Drive our open-source work. Release components so customers and the community can use them, and work with them to improve those components
- Set up how the team runs its services: support, monitoring, alerts, CI/CD, integration test gates and on-call plans
Requirements
- BS, MS or PhD in Computer Science or a related field (or equivalent experience)
- Experience in a ML infrastructure
Nice to have: fault tolerance or checkpointing for large-scale distributed training on GPU supercomputers, building LLM-based agents or AI tools for performance analysis or troubleshooting, building external services or maintaining open-source projects in ML infrastructure
Skills
KubernetesSlurmPyTorchTensorFlowJAXRayNVIDIA GPUsnetworkingCI/CDmonitoringalertingon-callfault tolerancecheckpointingLLM-based agentsAI tools for performance analysistroubleshootingKubernetesSlurmPyTorchTensorFlowJAXRayCI/CDmonitoringalerting
Benefits
- equity
- benefits
More jobs nearby
Full description
Company details are for members
Sign up for a free job alert to see NVIDIA's profile, website and LinkedIn, and the same for every employer on Referso Jobs.