- Pune, Maharashtra, India
- Hybrid
- Full-time · Senior
- 4+ years
Design, build, and maintain scalable, secure, and highly available AWS infrastructure optimized for complex AI/ML workloads.
Responsibilities
- Design, build, and maintain scalable, secure, and highly available AWS infrastructure (EKS, Lambda, ECS, VPC, IAM) for AI/ML workloads using Terraform best practices.
- Own and continuously evolve GitLab CI/CD pipelines for AI platform services to enable fast, reliable, and repeatable automated releases.
- Architect a centralized observability stack using Prometheus and Grafana with golden-signal dashboards and design intelligent alerting strategies to lead efficient incident response.
- Define and track DORA metrics to drive delivery and reliability improvements while building self-healing, auto-scaling, and cost-optimized infrastructure for AI/ML services on Kubernetes.
- Implement infrastructure security best practices, establish platform governance standards, partner on production-grade AI/RAG deployments, and mentor junior/mid-level engineers.
Requirements
- Nice to have: LiteLLM
- Nice to have: Ray.io
- Nice to have: Anyscale
- Nice to have: Temporal
- Nice to have: LangGraph