- Charlotte, North Carolina, United States
- Hybrid
- Full-time · Staff
- 5+ years
As a Staff AI-Ops Engineer in the Platform Engineering team, you will play a pivotal role in operationalizing, monitoring, and governing the AI/GenAI platform and the models, pipelines, and agents that run on it.
Responsibilities
- Design and operate the MLOps/LLMOps backbone for the AI platform on Databricks and Azure Cloud Services
- Develop automated CI/CD pipelines and infrastructure-as-code for models, prompts, and agents using Databricks Asset Bundles
- Implement end-to-end lineage and version control across data, prompts, retrievals, models, and responses using MLflow
- Build observability for data quality, data and model drift, retrieval and hallucination/grounding health, application performance, and business KPIs
- Establish automated regression, A/B, canary, shadow, and champion-challenger validation
Requirements
- Bachelor’s degree in Computer Science, Machine Learning, Data Science, or related field