- Menlo Park, California, United States
- Full-time · Manager
- 2+ years
Lead and manage data labeling and evaluation pipelines for frontier healthcare AI models, overseeing task design, quality, workforce, and delivery.
Responsibilities
- Run end-to-end data pipelines for labeling and annotation
- Turn evaluation needs into concrete labeling tasks and rubrics
- Build and scale expert rater workforce
- Write and iterate labeling guidelines
- Engineer data quality systems at scale
Requirements
- Nice to have: Experience with RLHF pipelines
- Nice to have: Clinical or regulated data experience
- Nice to have: Label Studio
- Nice to have: Scale AI
- Nice to have: Surge AI