- Waterloo, Ontario, Canada
- On-site
- Full-time · Principal
A strategic software engineering lead passionate about improving the performance of machine learning models on AMD GPUs, optimizing ML inference and training workloads across the ROCm software stack.
Responsibilities
- Analyze and optimize the performance of ML models running on AMD GPUs with the ROCm stack
- Optimize code across multiple software layers, including PyTorch, vLLM, llama.cpp, and ROCm libraries, in both Python and C++
- Work with AMD's architecture specialists to improve future products
- Apply a data-driven approach, using profiling and benchmarking, to target optimization efforts
- Stay informed of software and hardware trends and innovations, especially in ML models, algorithms, and GPU architecture
Requirements
- Bachelor’s or Master's degree in Computer Science
- Bachelor’s or Master's degree in Computer Engineering
- Bachelor’s or Master's degree in Electrical Engineering
- Nice to have: HIP
- Nice to have: CUDA