- Taipei, Taiwan, Taiwan
- On-site
- Internship · Intern
Internship role focused on AI computing software development, specifically either TensorRT-LLM inference optimization or TensorRT Compiler graph optimization to push GPU performance for Generative AI.
Responsibilities
- Build and enhance high‑performance LLM inference pipelines on key LLM models.
- Analyze and optimize LLM model execution, scalability, and memory use.
- Collaborate across framework and research teams to deliver efficient multi‑GPU model serving for Agentic AI workloads.
- Work on the TensorRT compiler backend to improve graph transformations and code generation for NVIDIA GPUs.
- Develop compiler optimization passes, refine operator fusion, and optimize memory usage.
Requirements
- Master or higher degree in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics or related computing focused degree