- San Francisco, California, United States +1 more
- Full-time · Senior
- $216K–$270K per year
- 4+ years
As a Software Engineer on Agent Oversight, you will build the platform infrastructure that lets our production agents be observed, evaluated, and improved at scale. This includes building observability tooling, evaluation harnesses, and the pipelines that connect them to improvement loops.
Locations (2)
- San Francisco, California, United States
- New York, New York, United States
Compensation
the base salary range for this full-time position in the locations of San Francisco, New York, Seattle is: $216,000—$270,000 USD
Responsibilities
- Design and build core platform capabilities for deploying, monitoring, and evaluating agentic applications in production
- Build reliable APIs and data pipelines that capture agent telemetry, evaluation signals, and performance metrics at scale
- Work alongside ML engineers where platform work intersects with evaluation or improvement systems
- Own the reliability, scalability, and observability of platform components serving multiple concurrent enterprise and government customers
- Work cross-functionally with product, forward deployed engineering, and customers to translate real-world deployment requirements into platform features
