Execute solutions in one or more specialized ML areas, utilize ML infrastructure, and contribute to model optimization and data processing.
Implement and optimize collective operations (e.g., all-reduce, all-gather, reduce-scatter, all-to-all) in the XLA TPU backend, from HLO-level transformations to low-level code generation.
Improve compiler scheduling to overlap communication with computation, balancing latency, memory pressure and throughput.
Analyze current and upcoming TPU architecture and interconnect features and use them to improve scaling performance.
Work with ML performance and research teams to diagnose scaling bottlenecks and reach roofline performance on critical workloads.
Requirements
Bachelor’s degree in Computer Science or related field
Nice to have: Master's degree or PhD in Computer Science or related technical fields
Nice to have: 2 years experience with data structures and algorithms
Nice to have: Experience developing accessible technologies
Google's software engineers develop next-generation technologies that change how billions of users connect, explore, and interact with information and one another.
Responsibilities
Write product or system development code.
Collaborate with peers and stakeholders through design and code reviews to ensure best practices amongst available technologies.
Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback.
Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.
Implement solutions in one or more specialized ML areas, utilize ML infrastructure, and contribute to model optimization and data processing.