Machine Learning Engineer, Evaluation
We’re looking for a Machine Learning Engineer to build and improve ML-powered products, with a particular focus on evaluating their quality and reliability. You’ll work across the ML lifecycle, combining hands-on engineering with rigorous experimentation to understand how systems perform and where they need to improve.
- Posted Nov 20, 2026
INDUSTRYHealthcareAllied Health & Therapy
Responsibilities
- Build, deploy, and maintain ML models and services in collaboration with engineering and product teams.
- Design evaluation approaches that reflect product needs and real-world operating conditions.
- Create and maintain evaluation datasets, benchmarks, and automated regression tests that measure safety, empathy, and risk.
- Select appropriate metrics, analyze performance across meaningful data segments, and investigate failure modes.
- Design experiments and use statistical methods to judge whether an improvement is real.
- Connect offline evaluation results with what customers see in production.
- Develop tools that make evaluation repeatable and useful throughout development and release workflows.
- Communicate findings, limitations, and recommendations clearly to clinicians, product leads, and customers.
Requirements
- Experience in a Clinical
- Experience in a Therapy
- Experience in a Clinical-trial
Nice to have: A/B testing, Production performance monitoring, Human evaluation, Annotation guidelines, Inter-rater agreement, Speech or conversational data, Robustness testing, Fairness analysis, Distribution shift detection
Skills
PythonML fundamentalsEvaluation metricsBenchmark designSystematic error analysisStatistical inferenceExperimental designSoftware engineering practicesML frameworks
Full description
mpathicCompany details are for members
Sign up for a free job alert to see mpathic's profile, website and LinkedIn, and the same for every employer on Referso Jobs.