Software Engineering Manager, AI/ML Infrastructure and Performance Engineering
Google · Posted Nov 10, 2026
- Bengaluru, Karnataka, India
- On-site
- Full-time · Manager
- 8+ years
Lead a team of software engineers focused on AI/ML infrastructure and performance engineering, driving technical leadership, project delivery, and cross‑team collaboration across Google’s global ML stack.
Responsibilities
- Learn and build an intuitive understanding of existing data collection, analysis, and visualization workflows with deep introspection across Frameworks, Accelerated Linear Algebra (XLA) and runtime stack.
- Support new and exciting ML paradigms (such as horizontal scaling for upcoming TPU chips) by making contributions across the end to end stack and analysis tools.
- Partner with ML Stack leads to understand model optimization use cases and bring debugging to feel native in 3P environments (VSCode, Cursor, Grafana, etc.).
- Work with OSS ML inference frameworks such as vLLM, SGLang to provide insights in Xprof about performance improvement opportunities.
- Partner with other teams that own various parts of the ML stack to understand performance optimization use cases.
Requirements
- Bachelor's degree or equivalent practical experience
Skills
software engineeringmachine learning infrastructurecomputer architecturedistributed computingpeople managementdebugging toolsGPU programminghigh performance computinglarge language modelopen source contributionperformance optimizationperformance debuggingagentic workflowsTensorFlowJAXPyTorchKerasvLLMSGLangPathwaysTPU performance analysisVSCodeCursorGrafanaXLA