Senior Staff Software Engineer, AI/ML, Google Cloud Compute Infrastructure
Google · Posted Nov 4, 2026
- Sunnyvale, California, United States
- On-site
- Full-time · Senior
- $262K–$364K per year
- 8+ years
Lead the technical goal, roadmap, and software architecture for hardware/software co-design, optimizing large-scale ML inference and training systems.
Compensation
US: $262000 - $364000 (USD) + 25% bonus target + equity + benefits
Responsibilities
- Lead the technical goal, roadmap, and software architecture for hardware/software co-design, optimizing large-scale ML inference and training systems.
- Design, develop, and oversee simulation frameworks, cycle-accurate performance models, and system analysis tools to evaluate architectural trade-offs.
- Architect scalable software solutions, kernels, and execution pipelines that bridge frontier ML model architectures with next-generation custom silicon accelerators.
- Drive system-level performance optimization across distributed ML infrastructure, balancing compute, memory bandwidth, and inter-chip networking requirements.
- Provide technical leadership and mentorship across hardware, compiler, and ML research teams to align on goals and transition co-design innovations into production.
Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience
- Nice to have: Master’s degree or PhD in Engineering, Computer Science, or related field
- Nice to have: technical leadership experience
- Nice to have: multi-generational hardware/software co-design