Senior System Software Architect, AI and GPU Networking
Senior Architects are innovators who can translate business needs into workable technology solutions. As a Senior architect in the AI Networking Research team, you will explore technological challenges on accelerated networking and building AI data centers.
- Tel Aviv, Tel Aviv, Israel
- Posted Nov 11, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareAI & Machine LearningData & Analytics
Responsibilities
- Enhance NVIDIA’s GPU Networking offerings for accelerating AI workloads, such as NVIDIA Dynamo, NVIDIA NIXL and NVIDIA UCX, tailored to the unique requirements of AI workloads.
- Co-design hardware features (e.g., in GPUs, DPUs, or interconnects) that accelerate data movement and enable new capabilities for inference and model serving.
- Identify and evaluate new technologies, innovations and partner relationships for alignment with our technology roadmap and business value.
- Lead architecture and design of new technologies and innovations such as runtime systems, communication libraries, AI-specific technologies.
- Lead proof-of-concept development to evaluate and drive such technologies.
Requirements
- B.Sc., M.Sc. or Ph.D. in Computer Science, Electrical or Computer Engineering from a leading university (or equivalent experience)
- Experience in a AI
- Experience in a Deep Learning
Nice to have: Shown research track record, Experience and passion for system architecture, CPU/GPU/memory/storage/networking, Knowledge in Deep Learning frameworks and AI communication libraries (NCCL, UCX, MPI and equivalents), Deep understanding of Inference and Training workloads and optimizations, like Prefill/Decode, data parallelism, Tensor parallelism, FSDP
Skills
System architectureAI systems architectureAlgorithm designSystem programmingComputer architectureOperating systemsVirtualizationNetworkingStoragePerformance profiling and optimization techniquesStrong programming and software development skillsNVIDIA DynamoNVIDIA NIXLNVIDIA UCXNCCLMPI
Full description
Company details are for members
Sign up for a free job alert to see NVIDIA's profile, website and LinkedIn, and the same for every employer on Referso Jobs.