Back to search

Nvidia Network Engineer

Network Engineer responsible for designing, deploying, and optimizing InfiniBand, RoCE, and Ethernet fabrics for NVIDIA GPU infrastructure.

  • Chennai, Tamil Nadu, India
  • Posted Nov 12, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software

Responsibilities

  • Build InfiniBand (HDR/NDR) East-West fabrics and Ethernet North-South connectivity using Leaf-Spine architecture with ECMP
  • Deploy and optimize RoCE v2, PFC/ECN, MTU, buffer profiles, InfiniBand routing, credits, and timers
  • Implement SHARP/UCX offloads wherever applicable
  • Monitor Day 2 fabric health, including congestion hotspots, slow drain issues, and link flaps
  • Automate network configurations using Ansible and Terraform
  • Manage switch OS/firmware lifecycle, optics and cable qualification, inventory, and spares
  • Validate NCCL collective performance across pods
  • Troubleshoot AllReduce bottlenecks and performance imbalances
  • Implement QoS classes for training, inference, and control plane workloads
  • Lead P0/P1 critical incident responses for NVIDIA GPU infrastructure
  • Troubleshoot performance bottlenecks involving InfiniBand fabrics, RoCE networks, congestion management, NCCL communications, GPUDirect RDMA, and distributed AI training workloads
  • Conduct post-incident reviews and implement automation, monitoring enhancements, and architectural improvements
  • Create runbooks for path failures, fabric partitions, and credit starvation
  • Design graceful degradation mechanisms to maintain service reliability
  • Implement BGP/EVPN multi-tenancy, ACLs, and role-based access controls for fabric managers
  • Ensure configuration signing and change control compliance

Requirements

  • BE/B.Tech or equivalent degree in Computer Science or Electronics & Communication
  • Experience in a GPU infrastructure
  • Experience in a AI/ML cluster environments

Skills

InfiniBandRoCEEthernetLeaf-SpineECMPPFC/ECNMTUbuffer profilesInfiniBand routingcreditstimersSHARPUCXAnsibleTerraformswitch OS/firmwareopticscable qualificationNCCLAllReduceQoSBGP/EVPNACLsrole-based access controlsAnsibleTerraformNCCLSHARPUCX

Full description

Title: Nvidia Network Engineer Location: Chennai Exp: 7-15 Yrs Job Description: Key Responsibilities Implementation Build InfiniBand (HDR/NDR) East-West fabrics and Ethernet North-South connectivity using Leaf-Spine architecture with ECMP. Deploy and optimize RoCE v2, PFC/ECN, MTU, buffer profiles, InfiniBand routing, credits, and timers. Implement SHARP/UCX offloads wherever applicable. Operations Monitor Day 2 fabric health, including congestion hotspots, slow drain issues, and link flaps. Automate network configurations using Ansible and Terraform. Manage switch OS/firmware lifecycle, optics and cable qualification, inventory, and spares. Performance & Optimization Validate NCCL collective performance across pods. Troubleshoot AllReduce bottlenecks and performance imbalances. Implement QoS classes for training, inference, and control plane workloads. Reliability & Incident Management Lead P0/P1 critical incident responses for NVIDIA GPU infrastructure, including InfiniBand, RoCE, Ethernet fabrics, and AI/ML cluster environments. Troubleshoot performance bottlenecks involving InfiniBand fabrics, RoCE networks, congestion management, NCCL communications, GPUDirect RDMA, and distributed AI training workloads. Conduct post-incident reviews and implement automation, monitoring enhancements, and architectural improvements to improve cluster availability, stability, and performance. Create runbooks for path failures, fabric partitions, and credit starvation. Design graceful degradation mechanisms to maintain service reliability. Security & Compliance Implement BGP/EVPN multi-tenancy, ACLs, and role-based access controls for fabric managers. Ensure configuration signing and change control compliance. Educational Qualifications - BE/B.Tech or equivalent degree in Computer Science or Electronics & Communication. Relevant Experience - Experience: Not specified in the provided requirements.

Nvidia Network Engineer at NR Consulting - India | Referso Jobs