- Menlo Park, California, United States +1 more
- On-site
- 4+ years
Content Engineer
Locations (2)
- Menlo Park, California, United States
- New York, New York, United States
Responsibilities
- Define and apply quality criteria for assigned AI product capabilities
- Build and maintain guidelines, golden response sets, and benchmarks across features and surfaces
- Develop failure-mode taxonomies that turn user-facing quality issues into structured, prioritized findings for technical partners
- Design and run human evaluation workstreams, including rubric development, annotator guidance, calibration, and analysis of results
- Partner with research science to support automated evaluation and validate automated quality signals against human ratings
Requirements
- Bachelor's degree in a directly related field
