- Santa Clara, California, United States
- Full-time · Senior
- $184K–$357K per year
- 6+ years
Design and build scheduling for large GPU fleets on Slurm and Kubernetes, develop policy layers, run Slurm as a cloud-native service, build services around the scheduler, measure and raise goodput, own reliability, contribute to open-source projects, and collaborate across teams.
Compensation
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 184,000 USD – 287,500 USD for Level 4; and 224,000 USD – 356,500 USD for Level 5.
Responsibilities
- Design and build scheduling for large GPU fleets on both Slurm and Kubernetes
- Build the policy layer: fair share, quotas and allocations across many research teams
- Run Slurm as a cloud-native service on Kubernetes
- Extend Kubernetes batch scheduling for training, reinforcement learning, sandboxes and inference
- Build services around the scheduler: reservation automation, node-health-aware placement, workflow orchestration across clusters, and APIs
Requirements
- BS or MS in Computer Science, Computer Engineering, Electrical Engineering or a related field, or equivalent experience
- Nice to have: Experience scheduling large-scale AI training
- Nice to have: Contributions to Slurm, Kubernetes SIG Scheduling, Kueue, Volcano, KAI or similar open-source schedulers
- Nice to have: Experience running Slurm on Kubernetes
- Nice to have: Experience with workflow orchestrators such as Flyte, Airflow, Ray or Kubeflow