Principal GenAI Inference Optimization Engineer
Advanced Micro Devices, Inc · Posted Mar 27, 2026
- San Jose, California, United States
- Senior
Lead optimization of generative AI inference workloads on AMD GPU platforms, improving performance, latency, throughput, and cost efficiency across single-node and distributed environments.
Responsibilities
- Optimize performance of GenAI inference workloads on AMD GPU platforms across single-node and distributed environments.
- Improve latency, throughput, and cost efficiency for LLM and multimodal model serving in production.
- Analyze and resolve bottlenecks across compute, memory, and communication.
- Contribute to cross-stack optimizations spanning kernels, runtimes, communication libraries, and inference/serving frameworks.
- Implement and evaluate inference optimization techniques such as batching strategies, quantization, prefix caching, and speculative decoding.
Requirements
- B.S. in Computer Science
- M.S. in Computer Science
- Ph.D. in Computer Science
- B.S. in Computer Engineering
- M.S. in Computer Engineering