- Hyderabad, Telangana, India
- Hybrid
- Full-time · Senior
- 7–11 years
Lead the design, build, and execution of evaluations of AI systems across the stack, from foundation and fine-tuned models to retrieval-augmented generation (RAG) pipelines and agentic applications, assessing quality, accuracy, robustness, and safety
Compensation
Competitive salary, incentive pay, and many more.
Responsibilities
- Lead the design, build, and execution of evaluations of AI systems across the stack
- Define and develop evaluation datasets, test suites, metrics, and scoring rubrics
- Own the evaluation strategy and architecture
- Analyze and interpret evaluation results
- Partner with AI engineering, product, and risk and governance teams
Requirements
- Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Engineering, or a related science or technology discipline