Ship support for new open-source models, tuning them for latency and throughput; optimize inference serving; write and tune kernels; design, deploy, and operate heterogeneous clusters; run production inference; work with customers to understand technical needs and solve infrastructure problems.
Compensation
Base salary: $200,000 to $300,000 annually. Visa sponsorship is available.
Responsibilities
Ship support for new open-source models, tuning them for latency and throughput.
Optimize inference serving with techniques such as batching, KV caching, speculative decoding, and quantization.
Write and tune kernels using CUDA, HIP, and Triton across a range of accelerator platforms.
Design, deploy, and operate heterogeneous clusters across infrastructure vendors.
Run production inference across a mixed hardware fleet, improving reliability, observability, and cost efficiency.
Design, deploy, and operate machine learning training and inference workloads on Amazon Web Services infrastructure, integrating generative models into production pipelines and optimizing GPU utilization.
Locations (2)
Culver City, California, United States
New York, New York, United States
Compensation
USA, CA, Culver City - 143,700.00 - 194,400.00 USD annually
USA, NY, New York - 158,100.00 - 213,800.00 USD annually
Responsibilities
Design, deploy, and operate ML training and inference workloads on EKS
Integrate generative ML models into production inference pipelines
Build training and fine‑tuning pipelines on EKS and SageMaker
Improve GPU utilization, throughput, and latency on the inference fleet
Build automated evaluation pipelines and quality metrics
Requirements
Bachelor's degree in computer science or equivalent
Nice to have: full software development life cycle
Deployment Engineer who combines hands‑on AI engineering, model optimization, and strong customer‑facing skills to bring AI models and applications into production, improve performance, and integrate them with enterprise systems.
Locations (3)
Bellevue, Washington, United States
San Francisco, California, United States
Sunnyvale, California, United States
Responsibilities
Lead technical discovery to define use cases, workloads, infrastructure constraints, and targets for model quality, latency, throughput, and cost
Optimize inference using techniques such as quantization, batching, prefix caching, KV‑cache optimization, and parallelism
Adapt models to customer needs through prompt optimization, retrieval‑augmented generation, and fine‑tuning
Troubleshoot performance issues across model execution, GPU utilization, memory consumption, serving infrastructure, and application behavior
Research Engineer to make generative models dramatically faster, smaller and cheaper to run on-device and on server, working across the whole efficiency stack.
Locations (2)
Cupertino, California, United States
Seattle, Washington, United States
Responsibilities
Develop and deploy optimizations algorithms to speed up inference of production diffusion models (PTQ, QAT, kernel fusion, model distillation)
Design hardware-aware architectures that fit within compute and memory limits with minimal loss of quality
Own the process end-to-end from prototyping, evaluation to deployment into the Apple ecosystem
Requirements
M.S. or PhD in Computer Science or a related field such as Electrical Engineering, Robotics, Statistics, Applied Mathematics
Designs, builds, and operates secure, scalable AI systems focusing on Retrieval-Augmented Generation pipelines, agentic AI, and enterprise-grade service delivery across Azure and AWS.
Responsibilities
Architect and implement AI solutions
Integrate and operate AI infrastructure
Develop and manage data pipelines
Build agentic AI solutions
Model evaluation and optimization
Requirements
Bachelor’s degree in Computer Science, Engineering, Information Technology, Data Science
Nice to have: Microsoft Certified: Azure AI Engineer Associate
Nice to have: Microsoft Certified: Azure Data Scientist Associate
Nice to have: Microsoft Certified: Azure Solutions Architect Expert
Nice to have: Microsoft Certified: Azure Developer Associate
health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)