- Poland
- Hybrid
- Full-time · Lead
- 6+ years
Lead QA Engineer focused on designing voice AI test strategy and process, covering speech input, ASR, LLM, tools, integrations, and speech output.
Responsibilities
- Design the voice AI test strategy and process, from speech input through speech recognition (ASR), the LLM, tools and integrations, to speech output.
- Define the automation approach and how it scales, including multilingual coverage.
- Evaluate LLM responses, prompts, and behavior.
- Monitor voice quality metrics as word error rate, intent accuracy, and task completion.
- Lead UAT and gather acceptance criteria.
Requirements
- ISTQB certification
- Nice to have: Multilingual coverage
- Nice to have: Promptfoo
- Nice to have: DeepEval
- Nice to have: LangSmith