- New York, New York, United States
- Staff
- $190K–$261K per year
- 8+ years
Build the control plane for Unity AI Gateway, routing AI requests, enforcing budgets, and ensuring reliability and efficiency of distributed AI workloads.
Compensation
$190,000—$261,250 USD
Responsibilities
- Build the routing layer that picks the right model for each request across quality, cost, latency, availability, and remaining budget
- Improve reliability, latency, and efficiency of distributed AI workloads
- Collaborate with research, platform, infra, and AI/ML teams to deliver seamless end-to-end experiences
- Shape how developers and data scientists build and interact with AI on Databricks
Requirements
- Nice to have: real-time serving
- Nice to have: AI infrastructure
- Nice to have: GPU orchestration
- Nice to have: Bedrock
- Nice to have: Vertex AI