AI Software Evaluation Engineer, Siri AI Quality
Play a part in the next revolution in human-computer interaction and redefine mobile computing through voice interaction! Apple's Siri AI Quality team is looking for a passionate and skilled AI Software Evaluation Engineer to join our mission of delivering the highest-quality AI experiences to millions of users worldwide. In this role, you will build the systems that evaluate Siri's AI experiences and turn the results into action.
- Cupertino, California, United States
- Full-time
- On-site
- Posted Nov 6, 2026
Responsibilities
- Investigate why test scenarios regress and which issues recur and turn failure and bug data into root-cause findings and recommendations
- Find gaps across app intents, features and product areas and partner with domain owners to close them
- Build and report on dataset quality, issue trends and coverage
- Design agentic workflows that propose, ground, validate, triage and nominate new evaluation scenarios with minimal manual effort
- Extend automated screening, triage and fix tooling to new domains and device platforms
- Define quality standards and deliver evaluation systems that guide Siri's development
Requirements
- Experience in a Software engineering
- Experience in a Quality engineering
- Experience in a Data engineering
- Experience in a ML engineering
Nice to have: Agent frameworks, MCP servers, Skills or plugins, Agentic testing, Voice assistants, Conversational AI, Multi-turn dialogue evaluation, Data schemas, Validation frameworks, JSON, Data visualization, Tableau, Snowflake, Coverage analysis, Traffic analysis, Taxonomy analysis, Root-cause analysis
Skills
More jobs nearby
Full description
AppleSign up for a free job alert to see Apple's profile, website and LinkedIn, and the same for every employer on Referso Jobs.