- United States
- Mid
- 3+ years
Build the engineering systems that help Bask Health test, evaluate, and improve AI-powered applications throughout their development and production lifecycles.
Responsibilities
- Design, build, and maintain software infrastructure that supports AI quality and evaluation across Bask Health.
- Develop backend services that execute and manage automated AI evaluations.
- Build reusable testing tools for large language model applications.
- Create APIs that allow engineering teams to submit evaluation jobs and retrieve results.
- Develop systems for managing evaluation datasets, test cases, and expected outcomes.
Requirements
- Nice to have: AI evaluation infrastructure
- Nice to have: OpenAI
- Nice to have: Anthropic
- Nice to have: LangSmith
- Nice to have: DeepEval