Lead technical roadmap and architecture for product areas or infrastructure domains, design complex distributed systems, drive cross‑functional initiatives, and provide technical leadership across engineering teams.
Compensation
The pay range for this role is $156,000 - $255,000.
Responsibilities
Drive technical roadmap and architecture for product areas or infrastructure domains
Design highly complex, multi‑tiered distributed systems
Identify, champion, and execute large‑scale cross‑functional initiatives
Define technical strategies and de‑risk ambiguous product requirements
Scale distributed applications and deliver high‑quality code
The US base salary range for this full-time position is $147,000- $211,000 + 15% bonus target + equity + benefits determined by role, level, and location.
Responsibilities
Write software product or system code.
Design software modules and participate in design reviews with peers and stakeholders to decide amongst available technologies.
Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
Participate in software testing, e.g. develop unit tests and release tests.
Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback; and Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.
Requirements
Bachelor’s degree in Computer Science, Engineering, Mathematics, Information Systems, or a related field
Lead the development of LLM inference infrastructure and architectural direction of large-scale ML training and real-time inference systems for Amazon Ads.
Locations (3)
Seattle, Washington, United States
Arlington, Virginia, United States
New York, New York, United States
Compensation
USA, CA, Palo Alto - 193,300.00 - 261,500.00 USD annually
Responsibilities
Lead the development of LLM inference infrastructure for next-generation GenAI workloads at Amazon Ads scale
Own the architectural direction of large-scale ML training and real-time inference systems
Partner with applied scientists to design and optimize end-to-end ML pipelines
Influence technical direction beyond your team by establishing ML infrastructure best practices
Technical Program Manager III, Infrastructure Deployment Software NPI, Google Cloud
Lead complex, multi-disciplinary projects to design and deliver automated software solutions supporting Google’s data center infrastructure capacity expansion.
Partner with AI-native founders and engineering teams to design, optimize, and scale AI platforms on NVIDIA technologies, focusing on agentic systems, AI copilots, and multimodal AI.
Compensation
expected base salary ranges for this position are: 152,000 USD – 241,500 USD for Level 3; and 184,000 USD – 287,500 USD for Level 4.
Responsibilities
Serve as a trusted technical advisor to the next generation of AI-native companies building category-defining applications such as developer copilots, AI search engines, agentic platforms, and multimodal creative tools.
Work directly with startup founders and engineering teams to architect and optimize AI workloads using NVIDIA technologies including CUDA-X libraries, TensorRT-LLM, Triton Inference Server, NVIDIA NeMo, NIM microservices, and GPU-accelerated data processing frameworks.
Help AI-native companies scale training and inference infrastructure, optimizing model performance, cost efficiency, and latency across NVIDIA accelerated computing platforms.
Guide startups through complex architectural decisions including model optimization, inference scaling, agent frameworks, multimodal pipelines, and real-time AI systems.
Collaborate closely with NVIDIA engineering, research, product, and go-to-market teams to identify emerging AI-native categories and influence NVIDIA’s platform roadmap.
Requirements
BS/MS degree or equivalent experience in Computer Science, Engineering, or a related field
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 152,000 USD – 241,500 USD for Level 3; and 184,000 USD – 287,500 USD for Level 4.
Responsibilities
Serve as a trusted technical advisor to the next generation of AI-native companies building category-defining applications such as developer copilots, AI search engines, agentic platforms, and multimodal creative tools.
Work directly with startup founders and engineering teams to architect and optimize AI workloads using NVIDIA technologies including CUDA-X libraries, TensorRT-LLM, Triton Inference Server, NVIDIA NeMo, NIM microservices, and GPU-accelerated data processing frameworks.
Help AI-native companies scale training and inference infrastructure, optimizing model performance, cost efficiency, and latency across NVIDIA accelerated computing platforms.
Guide startups through complex architectural decisions including model optimization, inference scaling, agent frameworks, multimodal pipelines, and real-time AI systems.
Collaborate closely with NVIDIA engineering, research, product, and go-to-market teams to identify emerging AI-native categories and influence NVIDIA’s platform roadmap.
Requirements
BS/MS degree or equivalent experience in Computer Science, Engineering, or a related field
Nice to have: building or scaling AI-powered products
health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
Software Engineering Manager II, TPU Superpod Health ManagementNewGoogle · Sunnyvale, US
Senior Software Development EngineerAmazon · Seattle, US+1 more