Research Engineer, Benchmarks
Join a small, technical team building benchmarks to evaluate frontier AI agents on realistic, domain-specific workflows. You will own evaluation design and implementation, helping ensure benchmark results are rigorous, credible, and relevant to real-world performance.
- Singapore, Singapore
- Full-time
- On-site
- $100K–$170K per year
- Posted Nov 18, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareAI & Machine LearningData & Analytics
Responsibilities
- Design, implement, and maintain benchmarks for evaluating frontier agents on domain-specific tasks.
- Work with subject-matter experts to translate real workflows into realistic tasks and evaluation criteria.
- Build reliable infrastructure for running models and agents against benchmark tasks at scale.
- Develop metrics and analyses to assess benchmark difficulty, reliability, and failure modes.
- Validate whether benchmark results correlate with real-world evaluations and user needs.
- Write clear documentation and reports for technical audiences.
Requirements
- Technical education or equivalent grounding
- Experience in a AI agents
- Experience in a large language models
Nice to have: reinforcement learning pipelines, data generation, agent evaluation
Skills
Full description
Clera-AICompany details are for members
Sign up for a free job alert to see Clera-AI's profile, website and LinkedIn, and the same for every employer on Referso Jobs.