- United States
- 3+ years
Design, build, and maintain machine learning evaluation infrastructure across Bask Health.
Responsibilities
- Design, build, and maintain machine learning evaluation infrastructure
- Develop platform services that execute and manage automated model evaluation workloads
- Build scalable systems for running large batches of model and AI application evaluations
- Implement job orchestration, scheduling, and execution management for evaluation pipelines
- Develop infrastructure for storing and versioning evaluation datasets
Requirements
- Nice to have: MLflow
- Nice to have: Weights & Biases
- Nice to have: model registries
- Nice to have: artifact management
- Nice to have: large language model evaluation frameworks