- Santa Clara, California, United States
- Internship · Intern
Work on systems that run, scale, and optimize modern AI models, involving model serving, distributed training, scheduling, caching, communication, framework integration, or runtime performance.
Responsibilities
- Develop and benchmark inference or training framework components
- Run and integrate models using PyTorch, JAX, vLLM, or related frameworks
- Analyze latency, throughput, memory usage, and distributed performance
- Experiment with batching, caching, scheduling, and parallel execution
- Build multi-GPU inference or training prototypes
Requirements
- Bachelor’s in Computer Science, Computer Engineering, or a related field
- Master’s in Computer Science, Computer Engineering, or a related field
- PhD in Computer Science, Computer Engineering, or a related field
- Nice to have: PyTorch
- Nice to have: JAX
