- Austin, Texas, United States
- On-site
- Full-time · Senior
- 0+ years
Research, design, develop, and test high-performance collective communication libraries, GPU communication runtimes, and benchmarking tools for AI/HPC workloads on AMD Instinct GPUs and next-generation accelerator platforms.
Responsibilities
- Research, design, develop, and test high-performance collective communication libraries, GPU communication runtimes, and benchmarking tools for AI/HPC workloads.
- Design, develop, optimize, troubleshoot, and debug software that enables efficient multi-GPU and multi-node communication across AMD's ROCm software stack.
- Contribute to open-source libraries for GPU communication, including RCCL (ROCm Collective Communications Library) and benchmarking tools including TransferBench.
- Maximize bandwidth utilization and minimize latency across PCIe, Infinity Fabric (xGMI), and high-speed network interconnects (RDMA/RoCE/InfiniBand).
- Develop and tune collective algorithms (AllReduce, AllGather, ReduceScatter, Broadcast, AllToAll, etc.) for distributed training and inference frameworks such as PyTorch, JAX, Megatron-LM, DeepSpeed, and vLLM.
Requirements
- Master’s degree in Computer Science
- Computer Engineering
- Electrical Engineering