Lead the development of machine learning models and production Swift code for Apple Watch fitness features, driving end‑to‑end model lifecycle from prototype to shipping.
Responsibilities
Build datasets, evaluations, prompts and model adaptations for Apple Watch and iPhone fitness features
Write production Swift code that ships in the OS and runs on device and server
Collaborate with Activity, Workout, Fitness+ and Siri engineering teams to integrate intelligence
Set technical direction for a new and fast‑moving domain
Develop tools and harnesses for organization‑wide model development and evaluation
As our first AI Agent Evaluation Engineer, you define what quality means for every agent we run, you build the systems that measure it across every conversation, and you are the person the company trusts when the question is “how good is it, really?”
Locations (2)
Canada
United States
Compensation
In addition to base pay, total compensation includes equity and a comprehensive benefits package for you and your family.
Responsibilities
Define and maintain the evaluation rubric for the agent across three axes: adherence, outcome, and conversation experience
Write the annotation guidelines and failure taxonomy
Classify and prioritize failure modes by severity and frequency
Review production conversations by hand every week
Build and operate the evaluation pipeline that scores every production conversation
Requirements
Bachelor’s degree in Computer Science, Computational Linguistics, Cognitive Science, Statistics, or a related field
Lead the Input & Internationalization NLP team in Tokyo, managing software and ML/NLP engineers to build core technologies for Apple keyboards and input methods.
Responsibilities
Lead a team of software engineers and ML/NLP engineers building core technologies for input experience
Set technical vision and roadmap, drive project execution, deliver features
Partner with ML Platforms/Tooling, Human Interface/Design, Localization and Product Marketing teams
Build and grow a diverse team, promote healthy culture, drive process improvements, support career growth