- Redmond, Washington, United States
- On-site
- Full-time · Senior
- $120K–$235K per year
- 3–4 years
Applied research focused on advancing efficiency across the AI stack, spanning models, ML frameworks, cloud infrastructure, and hardware, driving mid- and long-term product innovation.
Compensation
The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
Responsibilities
- Formulate, develop, and evaluate new algorithmic and system-level approaches for end-to-end AI serving
- Design and experimentally evaluate endpoint configuration and execution policies, including batching, routing, and scheduling strategies
- Perform hardware- and kernel-aware optimization by collaborating closely with model, kernel, compiler, and hardware teams
- Build and benchmark experimental prototypes and large-scale measurements to validate research ideas and drive them toward production readiness
- Publish research results, file patents, and, where appropriate, contribute to open-source systems and serving frameworks
Requirements
- Doctorate in relevant field
- Master's Degree in relevant field
- Bachelor's Degree in relevant field
- Nice to have: Designing and optimizing efficient inference systems
- Nice to have: Deep knowledge of attention and KV-cache optimizations