- Menlo Park, California, United States
- On-site
- 10+ years
Lead technical direction and quality initiatives for Meta’s GenAI products, building evaluation systems and driving cross‑team quality strategy.
Responsibilities
- Define and drive the technical quality strategy and roadmap for a major Gen AI initiative spanning multiple engineering teams
- Lead and perform hands‑on testing of consumer‑facing and business‑facing applications, APIs, and AI models
- Architect and implement shared AI evaluation and test automation systems that support multiple models, products, and platforms
- Establish consistent evaluation methods, benchmark design, product‑aligned weighted scoring frameworks, and quality standards for model behavior and end‑to‑end product experiences
- Lead the development of reliable evaluation signals, including calibration of human and automated judgments, analysis of measurement uncertainty, and investigation of gaps between offline evaluations and real‑world outcomes
Requirements
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience