Senior Platform Engineer, AI Infrastructure
Lead the build-out of an enterprise AI platform for a global enterprise client, designing the foundation for teams to ship LLM applications and agents including Kubernetes, GPU capacity, and security.
- Denver, Colorado, United States
- Full-time
- Hybrid
- $180K–$220K per year
- Posted Nov 3, 2026
INDUSTRYSoftware & InternetAI & Machine Learning
Responsibilities
- Design and build a multi-tenant platform for LLM and agentic AI workloads, from model access to deployment
- Architect GPU infrastructure for inference and fine-tuning, including scheduling, autoscaling, and cost controls
- Stand up shared services for agents: model gateways, secrets, tracing, evaluation, and deployment pipelines
- Make build-vs-buy calls and explain the tradeoffs to technical and executive stakeholders
- Architect and run production Kubernetes on Azure AKS and GCP GKE
- Own Terraform modules and IaC standards across environments
- Build CI/CD and GitOps workflows that make platform changes safe and repeatable
- Design identity, network isolation, and secrets management for AI workloads
- Put guardrails in place for data access, model usage, and auditability
- Partner with security and compliance teams to meet enterprise requirements
- Mentor and direct a Platform Engineer on the engagement
- Lead architecture reviews and write the decision records that outlast the engagement
- Build trust with client engineering leaders and leave their team able to run what we build
Requirements
- Experience in a infrastructure
- Experience in a platform
- Experience in a DevOps engineering
Nice to have: internal agentic AI platform, vLLM, Triton, KServe, Ray Serve, Azure OpenAI, Vertex AI, consulting
Skills
KubernetesAzure AKSGCPTerraformGPU infrastructureLLM workloadsIAMnetworkingsecretspolicy as codeKubernetesAzure AKSGCP GKETerraformNVIDIA GPU Operator
More jobs nearby
Full description
Company details are for members
Sign up for a free job alert to see Focused's profile, website and LinkedIn, and the same for every employer on Referso Jobs.