- New York City, New York, United States +1 more
- On-site
- Full-time · Mid
Build the system that determines whether a voice agent is ready for patients, owning realistic audio tests, scoring, and the release gate.
Locations (2)
- New York City, New York, United States
- San Francisco, California, United States
Responsibilities
- Build simulated callers and call-replay tests that exercise the production voice path with real audio
- Test phone trees, hold queues, interruptions, conflicting clinical information and appropriate escalation
- Build scoring systems and calibrate automated judges against human assessments
- Measure clinical failure rates and uncertainty, and test whether simulation results predict behavior on real calls
- Define release criteria with model, runtime, product and clinical colleagues, own the gate and block changes that fail those criteria
Requirements
- Nice to have: Voice and audio experience
- Nice to have: Calibrating automated judges against human labels
