- Seoul, Korea
Software engineer to build AI routing and serving stack for AMD's vllm-sr.
Responsibilities
- Build routing intelligence for vllm-sr
- Make vllm-sr simple to deploy and operate
- Build vllm-sr into a universal serving engine
- Optimize decision model inference
- Train foundation decision models
Requirements
- Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or related field