- Argentina
AI/LLM Quality Engineering and Automation Engineering for AI-native applications
Responsibilities
- Design, validate, and optimise testing strategies for AI-powered applications, copilots, chatbots, RAG pipelines, and autonomous AI agents
- Develop AI evaluation frameworks for hallucination detection, groundedness, toxicity & bias validation, response quality, context relevance, prompt regression testing, determinism & consistency, safety and guardrail validation
- Build automated validation pipelines for LLM outputs using structured assertions, semantic scoring, embeddings, and evaluation metrics
- Create synthetic datasets and benchmark datasets for AI testing scenarios
- Test multi-agent orchestration workflows and agent memory/context retention
Requirements
- Bachelor’s/Master’s degree in Computer Science, Engineering, AI/ML, or related field
- Nice to have: Robot Framework
- Nice to have: Playwright
- Nice to have: LangChain
- Nice to have: LangGraph