GCP Infrastructure Engineer
Design, build, and manage cloud infrastructure for Generative AI applications on GCP.
- India
- Full-time
- Posted Sep 29, 2025
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Design, provision, and maintain scalable, secure, and cost‑efficient infrastructure for GenAI applications on GCP
- Deploy and manage containerized workloads using Docker and Kubernetes (GKE)
- Configure and optimize Vertex AI and IBM Watsonx platforms for training, fine‑tuning, and serving LLMs
- Implement high‑performance GPU/TPU clusters for distributed training and large‑scale inference
- Ensure business continuity through backup, disaster recovery, and multi‑region deployments
- Develop and maintain IaC templates with Terraform or Cloud Deployment Manager
- Adopt GitOps practices (Flux) for infrastructure lifecycle management
- Build and optimize CI/CD pipelines for data pipelines, model workflows, and GenAI applications
- Apply SRE principles (SLIs, SLOs, SLAs) to guarantee platform reliability and uptime
- Embed DevSecOps best practices across the infrastructure lifecycle
- Enforce IAM, network segmentation, and data encryption in compliance with standards
- Collaborate with enterprise security and compliance teams to implement governance frameworks
- Implement observability stacks (Prometheus, Grafana, Cloud Monitoring, Datadog) for infra health and ML‑specific metrics
- Define KPIs to monitor system health, performance, and adoption
- Optimize cloud cost efficiency for GPU/TPU‑intensive workloads
- Partner with data scientists, ML engineers, and software teams to streamline GenAI application development and deployment
- Provide onboarding, documentation, and reusable templates to enable faster adoption of AI infrastructure
- Stay current with the latest advancements in GenAI, cloud‑native infrastructure, and container orchestration
Requirements
- Bachelor’s or master’s degree in computer science, Software Engineering, or a related field
Nice to have: MLOps practices for model deployment, monitoring, and retraining, Multi‑cloud or hybrid cloud environments (GCP, AWS, Azure, on‑prem), Feature stores (Vertex AI Feature Store, Feast), ML observability tools (EvidentlyAI, Fiddler), Distributed training frameworks (Horovod, DeepSpeed, PyTorch Distributed), Open‑source contributions in infrastructure, MLOps, or GenAI, Experience managing infrastructure in regulated industries
Skills
Google Cloud Platform (GCP)Vertex AIIBM WatsonxDockerKubernetes (GKE)PythonBashTerraformPulumiAnsibleDeployment ManagerGitHub ActionsGitLab CIJenkinsDataflowApache BeamPub/SubKafkaGCPVertex AIIBM WatsonxDockerKubernetesGKEPythonBashTerraformPulumiAnsibleDeployment ManagerGitHub ActionsGitLab CIJenkinsDataflowApache BeamPub/SubKafkaPrometheusGrafanaCloud MonitoringDatadogFluxSRESLIsSLOsSLAs
Full description
Company details are for members
Sign up for a free job alert to see UPS Supply Chain Solutions's profile, website and LinkedIn, and the same for every employer on Referso Jobs.