Senior AI Evals Engineer (AI Quality & Safety) - Libra-Legal AI Assistant (m/w/d)
Wolters Kluwer · Posted Nov 5, 2026
- Berlin, Germany
- Hybrid
- Full-time · Senior
- 5+ years
Build and own the eval platform, design rubrics, optimize LLMs, and ensure AI quality for a legal AI platform at European scale.
Responsibilities
- Build and own the eval platform
- Map the quality landscape
- Design the rubrics and set the standard for LLM-as-judge
- Deep-dive results and traces
- Unhobble the optimizer
Requirements
- Bachelor's degree or equivalent in a relevant technical field (e.g. Computer Science, Software Engineering, Statistics, Data Science)
- Nice to have: GEPA
- Nice to have: DSPy
- Nice to have: embedding clustering