Member of Technical Staff, Distributed Training PerformanceNew
Hark · San Jose, US
$180K–$450K· Full-time
HPC ArchitectNew
AbbVie · Chicago, US
HPC EngineerNew
NexGen Cloud · Remote, United Kingdom
Remote · Full-time · Associate
Machine Learning, Recommendation Systems (Ads Infra and Ranking)New
Meta · Bellevue, US
On-site · Full-time · Senior
Senior System Software EngineerNew
NVIDIA · Bengaluru, India
Senior
Advanced Algorithm InternNew
KLA · Milpitas, US
$58–$58· On-site · Internship · Intern
Ingénieur - Développement d’une couche logicielle applicative pour bancs de mesure capteurs fibres et LiDAR haute résolution basés sur GPU (H/F) CDD 3 moisNew
Improve the performance of Hark's Megatron-based pretraining systems across thousands of GPUs, focusing on model FLOPs utilization, training throughput, and kernel performance.
Compensation
The US base salary range for this full-time position is between $180,000 - $450,000 annually.
Responsibilities
Own MFU and step time for pretraining runs across dense and mixture-of-experts models
Write or integrate fused and custom kernels (CUDA, Triton, CUTLASS) for attention, normalization, and mixture-of-experts routing
Overlap communication with compute, reduce pipeline bubbles, and tune activation recomputation and memory use to raise throughput per GPU
Implement model and optimizer sharding, and optimize data, tensor, pipeline, sequence, context, and expert parallelism for dense and mixture-of-experts architectures
Profile GPU kernels, collective communication, data loading, and mixed-precision training to identify performance and numerical stability bottlenecks
Requirements
Nice to have: mixture-of-experts training at scale
Nice to have: load balancing
Nice to have: all-to-all communication optimization
Provide technical leadership for scientific and R&D computing environments, architecting and evolving on-premises, cloud, and hybrid HPC platforms.
Compensation
The compensation range described below is the range of possible base pay compensation that the Company believes in good faith it will pay for this role at the time of this posting based on the job grade for this position.
Responsibilities
Serve as the technical architect for AbbVie IR’s on-premises, cloud, and hybrid HPC based scientific-computing environments
Design, implement, and support HPC compute and networking infrastructure
Administer and optimize Slurm workload management
Establish secure, reproducible container and scientific software environments
Assist with the architecture and support of Posit Workbench, Posit Connect, Posit Package Manager
Requirements
Bachelor’s Degree in Computer Science, IT, or related field
Master’s Degree
PhD
Nice to have: Work experience in the pharmaceutical industry
Validate, tune, and operate large-scale NVIDIA GPU clusters for HPC and AI workloads, ensuring performance and reliability before handover to customers.
Compensation
Competitive salary and annual discretionary bonus scheme
Responsibilities
Own cluster validation before handover
Collaborate with Deployment Solution Architects, Network Engineers, Validation and Support teams, and NVIDIA and OEMs on hardware faults and RMAs
Run production HPC clusters day to day, including Slurm, GPU drivers and the CUDA stack, InfiniBand fabrics and parallel storage clusters
Tune clusters for AI training and HPC workloads
Build GPU, fabric and job-level monitoring and lead incident response
Requirements
Nice to have: HGX H100/H200/B200 or GB200 rack-scale systems
We are seeking a Senior Software Engineer to work in our CUDA system software team.
Responsibilities
Design, develop, debug and deploy many functional aspects of NVIDIA hardware and mobile system-on-chip (SOC) devices
Be heavily involved through all aspects of development of world-class products, from design feedback to early modeling and simulation of hardware in pre-silicon environments, through early silicon bringup and finally deployment of features in production software delivered to end users
Contribute to the design of new compute and graphics drivers and new GPU architectures
Join the Advanced Algorithm team as a Summer Intern and contribute to cutting-edge research in metrology technologies. Investigating and characterizing next-generation solutions against current best-known methods.
Compensation
Base Pay Range: $58.00 - $58.00 per hour based on pursuit of a Ph.D.
Responsibilities
Innovate next-generation electromagnetic solvers and implement them on high-performance computing (HPC) platforms.
Explore machine learning techniques to accelerate electromagnetic solvers.
Ingénieur - Développement d’une couche logicielle applicative pour bancs de mesure capteurs fibres et LiDAR haute résolution basés sur GPU (H/F) CDD 3 mois
Join our Advanced Algorithm team as a Summer Intern and contribute to cutting‑edge research in metrology technologies, investigating and characterizing next‑generation solutions, collecting data, analyzing results, and automating workflows.
Compensation
Base Pay Range: $58.00 - $58.00 per hour based on pursuit of a Ph.D.
Responsibilities
Innovate next‑generation electromagnetic solvers and implement them on high‑performance computing (HPC) platforms.
Explore machine learning techniques to accelerate electromagnetic solvers.
Requirements
Currently pursuing a Ph.D. in Physics, Mathematics, Computer Science, Electrical Engineering, or a related field.
Nice to have: machine learning for image processing or image denoising
Seeking a Research Scientist to drive research on new large language model architectures that reduce the cost of inference while retaining performance, treating serving hardware realities as first-class design constraints.
Responsibilities
Design and implement new model components, such as attention variants, structured or sparse layers, routing mechanisms, activations and training objectives.
Run controlled pretraining experiments at matched compute, from small scale up to larger models.
Analyse the structure that trained models learn, and what it means for efficiency and interpretability.
Explore adapting existing open models through continued training or distillation.
Work with engineers to turn research ideas into reliable, reproducible training runs and efficient kernels.
Requirements
PhD in machine learning, computer science, physics or a related field, or equivalent research experience
Member of Technical Staff, Distributed Training PerformanceNewHark · San Jose, US
HPC EngineerNewNexGen Cloud · Remote, United Kingdom
Machine Learning, Recommendation Systems (Ads Infra and Ranking)NewMeta · Bellevue, US