Founding Infrastructure Engineer
As a founding engineer on the team, you'll build and operate the infrastructure behind our training, inference and agent workloads. A workload might involve launching thousands of containerized environments, scheduling jobs across GPU nodes and collecting results for the next training run.
- Palo Alto, California, United States
- Full-time
- Posted Nov 5, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Build and operate Kubernetes clusters for GPU training, model inference and agent execution.
- Create and maintain Docker images and reproducible environments for research and production workloads.
- Build systems to launch, monitor, clean up and recover thousands of concurrent containerized tasks.
- Improve scheduling, autoscaling and resource allocation to reduce GPU idle time and infrastructure costs.
- Automate infrastructure provisioning, deployments and upgrades using infrastructure as code and CI/CD.
- Build monitoring and debugging tools that make failures and performance bottlenecks easy to investigate.
- Troubleshoot issues across Linux hosts, containers, networking, storage and GPU infrastructure.
- Implement workload isolation, access controls and resource limits for shared clusters and agent environments.
- Work with researchers and ML engineers to turn experimental workflows into reliable systems.
- Own incident response and root-cause analysis, and make improvements to prevent recurring failures.
Requirements
- Bachelor's degree or equivalent practical experience
- Experience in a AI
- Experience in a Machine Learning
Nice to have: GPU clusters, SLURM, Volcano, Kubernetes scheduling, autoscaling, resource quotas, multi-tenant workload isolation, containerized sandbox environments, Terraform, Helm, Argo CD, Prometheus, Grafana, OpenTelemetry
Skills
KubernetesDockerGoPythonLinux systems administrationnetworkingstoragedistributed systemsAWSGCPAzureKubernetesDockerGoPythonAWSGCPAzureTerraformHelmArgo CDPrometheusGrafanaOpenTelemetry
Benefits
- bonus
- equity
- benefits
More jobs nearby
Full description
Peano AICompany details are for members
Sign up for a free job alert to see Peano AI's profile, website and LinkedIn, and the same for every employer on Referso Jobs.