LLM inference operations jobs

AI Computing Software Developer - New College Graduate 2027

NVIDIA · Posted Nov 10, 2026

Taipei, Taiwan, Taiwan
On-site
Internship · Intern

Apply with RefersoAI Apply on careers page

Internship role focused on AI computing software development, specifically in TensorRT-LLM inference optimization or TensorRT Compiler graph optimization to support LLMs, Recommender Systems, and Generative AI.

Responsibilities

Build and enhance high‑performance LLM inference pipelines on key LLM models.
Analyze and optimize LLM model execution, scalability, and memory use.
Collaborate across framework and research teams to deliver efficient multi‑GPU model serving for Agentic AI workloads.
Work on the TensorRT compiler backend to improve graph transformations and code generation for NVIDIA GPUs.
Develop compiler optimization passes, refine operator fusion, and optimize memory usage.

Requirements

Master or higher degree in Computer Science
Computer Engineering
Electrical Engineering
Applied Mathematics
related computing focused degree

Skills

Python PyTorch C++LLM inference operations GPU acceleration

LLM inference operations jobs

Responsibilities

Requirements

Skills

Responsibilities

Requirements

Skills

Benefits