- Remote
- Remote
- Full-time · Senior
- $120K–$145K per year
- 5+ years
Own the diagnostic loop for LLM-based clinical services: take failure modes surfaced by clinical reviewers and product managers, form root-cause hypotheses (prompt design, context assembly, retrieval, guideline encoding, model behavior, upstream data), and design experiments that isolate the cause.
Compensation
The expected base salary/wage range for this position is $120,000 - 145,000.
Responsibilities
- Own the diagnostic loop for LLM-based clinical services
- Test candidate fixes — prompt and configuration variants, context changes, model alternatives — and verify improvements with structured evaluations
- Own the evaluation roadmap and quality bar for the team's AI services
- Use and extend the team's evaluation platform: build golden sets and regression suites, define metrics (accuracy, guideline adherence, grounding/faithfulness), run and interpret eval batteries
- Partner with clinical reviewers (medical directors) to turn review findings into labeled evidence and executable evaluation criteria
Requirements
- Bachelor's degree in Data Science, Computer Science, Statistics, or a related quantitative field
- Nice to have: Healthcare experience
- Nice to have: utilization management
- Nice to have: prior authorization
- Nice to have: clinical documentation