- Sunnyvale, California, United States +1 more
- Full-time · Senior
- $182K–$242K per year
- 3–8 years
Lead design, architecture, and optimization of inference platform services, ensuring reliability and performance at scale.
Locations (2)
- Sunnyvale, California, United States
- Bellevue, Washington, United States
Compensation
The base salary range for this role is $182,000 to $242,000. The starting salary will be determined by job-related knowledge, skills, experience, and the market location. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).
Responsibilities
- Lead design reviews and drive architecture within the team; decompose multi-service work into clear milestones.
- Define and own SLIs/SLOs; ensure post-incident actions land and reliability improves release-over-release.
- Implement advanced optimizations (e.g., micro-batch schedulers, speculative decoding, KV-cache reuse) and quantify impact.
- Strengthen incident posture: capacity planning, autoscaling policy, graceful degradation, rollback/traffic-shift strategies.
- Mentor IC1/IC2 engineers; review cross-team designs and elevate coding/testing standards.