- Redmond, Washington, United States
- Senior
- $120K–$235K per year
- 3+ years
Compensation
The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
Responsibilities
- Formulate, develop, and evaluate new algorithmic and system-level approaches for end-to-end AI serving
- Design and experimentally evaluate endpoint configuration and execution policies
- Perform hardware- and kernel-aware optimization by collaborating with model, kernel, compiler, and hardware teams
- Build and benchmark experimental prototypes and large-scale measurements
- Publish research results, file patents, and contribute to open-source systems
Requirements
- Doctorate in relevant field
- Master's Degree in relevant field
- Bachelor's Degree in relevant field
- Nice to have: designing and optimizing efficient inference systems
- Nice to have: deep knowledge of attention and KV-cache optimizations