Senior Software Test Development Engineer - AI Infra, SDET
Develop automated tests and test infrastructure to validate the functionality, performance, scalability, and reliability of distributed AI systems across model training, post-training, and inference.
- Shanghai, China
- Full-time
- Posted Nov 19, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareAI & Machine LearningData & Analytics
Responsibilities
- Collaborate with global cross-functional teams to understand product requirements, identify quality risks, and own test strategy and coverage for assigned areas.
- Design, develop, execute, and automate functional, integration, regression, performance, and reliability tests for AI frameworks, distributed execution platforms, and end-to-end AI workloads.
- Validate distributed AI workloads across multi-GPU and multi-node environments, including deployment, resource management, scaling, and failure recovery.
- Develop and maintain Python-based test frameworks and CI/CD pipelines for reproducible testing across containerized and GPU cluster environments.
- Reproduce customer issues, isolate failures across software and infrastructure components, drive bug resolution, and verify fixes.
- Build AI-assisted QA workflows for test generation, execution, log analysis, failure triage, and reporting, with measurable improvements in efficiency and result quality.
Requirements
- Master’s degree in Computer Science, Computer Engineering, or a related field, or equivalent practical experience
- Experience in a distributed model training
- Experience in a LLM inference and serving
- Experience in a reinforcement learning post-training
Nice to have: PyTorch, vLLM, SGLang, NVIDIA TRT-LLM, NVIDIA Dynamo, Verl, Rust, model parallelism, inference scheduling, KV-cache management, Kubernetes Operators, CRDs, Helm, Prometheus, Grafana, OpenTelemetry, NVLink, InfiniBand/RoCE, RDMA, NCCL, NIXL
Skills
PythonTest AutomationSystems Software EngineeringLinux administrationDockerKubernetesSlurmCI/CD automationpytestDockerKubernetesSlurmCI/CD
Full description
Company details are for members
Sign up for a free job alert to see NVIDIA's profile, website and LinkedIn, and the same for every employer on Referso Jobs.