AI Inference & Training Framework Engineer Intern
Work on systems that run, scale, and optimize modern AI models, involving model serving, distributed training, scheduling, caching, communication, framework integration, or runtime performance.
- Santa Clara, California, United States
- Internship
- On-site
- Posted Nov 10, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareAI & Machine LearningDeveloper Tools & Infrastructure
Responsibilities
- Develop and benchmark inference or training framework components
- Run and integrate models using PyTorch, JAX, vLLM, or related frameworks
- Analyze latency, throughput, memory usage, and distributed performance
- Experiment with batching, caching, scheduling, and parallel execution
- Build multi-GPU inference or training prototypes
- Develop testing, profiling, and developer tooling
- Debug performance and correctness issues in real AI workloads
- Work directly with engineers on production-relevant infrastructure problems
Requirements
- Bachelor’s in Computer Science, Computer Engineering, or a related field
- Master’s in Computer Science, Computer Engineering, or a related field
- PhD in Computer Science, Computer Engineering, or a related field
- Experience in a ML systems
Nice to have: PyTorch, JAX, TensorFlow, vLLM, SGLang, multi-GPU model execution, CUDA, GPU programming, distributed training, distributed inference, Docker, Kubernetes, cloud infrastructure
Skills
PythonC++distributed systemsoperating systemsmachine learning systemsnetworkingparallel computingmodern ML frameworkPyTorchJAXvLLM
More jobs nearby
Full description
NeuroSparkCompany details are for members
Sign up for a free job alert to see NeuroSpark's profile, website and LinkedIn, and the same for every employer on Referso Jobs.