AI Power & Performance Engineer
Evaluate, benchmark, profile, and optimize AI inference workloads across modern CPU, GPU, APU, and heterogeneous computing platforms.
- Bangalore, Karnataka, India
- Posted Nov 5, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Benchmark and characterize AI inference workloads using PyTorch, ONNX Runtime, vLLM, llama.cpp, TensorFlow, and related technologies.
- Analyze latency, throughput, memory utilization, power consumption, and performance per watt.
- Profile workloads and identify bottlenecks across AI frameworks, runtimes, operating systems, memory subsystems, and hardware.
- Optimize workload performance through quantization, graph optimization, kernel tuning, memory optimization, and heterogeneous compute utilization.
- Conduct competitive benchmarking across AMD and competing CPU, GPU, APU, and AI accelerator platforms.
- Automate benchmark execution, data collection, regression analysis, and results visualization.
- Convert benchmarking results into actionable recommendations for software, hardware, product, and business teams.
- Collaborate with architects, framework, runtime, driver, firmware, and system software teams to resolve performance issues.
Requirements
- Bachelor’s or master’s degree in Computer Engineering, Electrical Engineering, Computer Science, Artificial Intelligence, Machine Learning, or a related field
Nice to have: ROCm, Ryzen AI Software, Vitis AI, MIGraphX, model quantization, mixed-precision inference, graph optimization, LLM-serving techniques, MLPerf Inference, Docker, virtualization, post-silicon performance validation
Skills
benchmarking AI inference workloadsPyTorchONNX RuntimevLLMllama.cppTensorFlowLinuxperformance profilingworkload tracingautomationsystem-level debuggingLinux perfAMD uProfROCm ProfilerNsight SystemsVTunePerfettoPythonBashPyTorchONNX RuntimevLLMllama.cppTensorFlowLinuxperfAMD uProfROCm ProfilerNsight SystemsVTunePerfettoPythonBash
Full description
Company details are for members
Sign up for a free job alert to see Advanced Micro Devices, Inc's profile, website and LinkedIn, and the same for every employer on Referso Jobs.