- San Francisco, California, United States +2 more
- Full-time · Senior
- $169K–$250K per year
- 7+ years
Lead evaluation research for AI products, designing studies, building rubrics, and guiding model and product improvements.
Locations (3)
- San Francisco, California, United States
- New York, New York, United States
- United States
Compensation
Annual Base Salary Range: $169,000—$250,000 USD
Responsibilities
- Own evaluation research for priority AI Research workstreams
- Define quality criteria, design studies, analyze results, and recommend actions
- Build rubrics, representative evaluation datasets, benchmarks, and quality thresholds
- Work with AI Research and Modeling Platform engineers to integrate validated methods into repeatable evaluations and regression tests
- Explain quality, failure patterns, and uncertainty