AIML - LLM Inference Quality Engineer
Own the correctness, consistency, and stability of LLM inference in production, designing and building automation frameworks and evaluation methodology for large-scale AI data center deployment.
- Seattle, Washington, United States
- Full-time
- On-site
- Posted Nov 19, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareAI & Machine LearningData & Analytics
Responsibilities
- Lead the qualification of an LLM inference, output-correctness, automation framework for large-scale AI data center deployment and platform validation.
- Architect qualification systems for generative AI, including agentic workflows and tool-using models, running at data center scale.
- Validate that outputs remain correct, consistent, and stable as models, weights, prompts, serving runtimes, quantization schemes, and accelerator hardware change underneath them.
- Write production-quality software in Python, C++, and/or Swift.
- Apply statistical and ML-evaluation methods to validate both data and model behavior.
- Build AI-assisted QA tooling that makes testing itself smarter and faster.
Requirements
- B.S., M.S., or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or equivalent experience
- Experience in a LLM
Nice to have: Go, JavaScript, operating systems, LLM testing/development
Skills
PythonC++SwiftAI/LLMsLLM serving and inference optimizationCI/CDKubernetescontainerscloud-native systemsPyTorchHugging Face TransformersObservabilitydistributed tracingSplunkPrometheusGrafanaLangSmith
More jobs nearby
Full description
AppleCompany details are for members
Sign up for a free job alert to see Apple's profile, website and LinkedIn, and the same for every employer on Referso Jobs.