- Bangalore, India
- Hybrid
- Full-time · Senior
- 7+ years
AI Test Engineer responsible for validating AI-enabled solutions in production environments, translating testing strategy into executable frameworks, and ensuring performance thresholds are met.
Responsibilities
- Translate AI testing strategy into executable test scenarios across LLM outputs, document classification, extraction accuracy, agent workflows, and edge cases
- Design adversarial and boundary test inputs to expose hallucination, misclassification, and failure modes
- Validate AI outputs for structure, consistency, accuracy, and production readiness against defined performance thresholds
- Build reusable Python-based evaluation frameworks, including output validation, hallucination detection, and scoring mechanisms
- Develop parameterized test scripts reusable across features, models, and releases
Requirements
- Bachelor’s degree required
- Advanced degree in Computer Science, Data Science, or related field preferred
- Nice to have: Advanced degree in Computer Science, Data Science, or related field