Distributed Inference jobs

AI Framework and Performance Experts(vLLM, SGLang)

Advanced Micro Devices, Inc · Posted Nov 11, 2026

Open

Shanghai, Shanghai, China
Senior

Apply with RefersoAI Apply on careers page

AI Framework and Performance Experts(vLLM, SGLang)

Advanced Micro Devices, Inc · Posted Nov 11, 2026

Open

Shanghai, Shanghai, China
Senior

Apply with RefersoAI Apply on careers page

Research Intern — Neural Network Training and Hardware–Software Co-Design

Meta · Posted Nov 10, 2026

Open

Burlingame, California, United States
On-site
Internship · Intern

Apply with RefersoAI Apply on careers page

Internship focused on designing and training neural networks for efficient execution on custom hardware for wearable and robotics devices.

Responsibilities

Design, train, and evaluate neural networks for on-device workloads under compute, memory, and energy constraints
Develop hardware-aware training and model compression techniques and measure their impact on target hardware
Explore partitioning models across multiple accelerators or chips, including how inter-chip communication affects accuracy and performance
Profile models end to end and use the measurements to drive both model and hardware design decisions
Prototype and validate on FPGA platforms, modifying and debugging existing RTL as needed

Requirements

PhD in Computer Science, Electrical/Computer Engineering, Machine Learning, or a related field

Skills

PyTorch TensorFlow Verilog SystemVerilog FPGA C/C++

Founding Machine Learning Infrastructure Engineer

Peano AI · Posted Jun 16, 2026

Open

Palo Alto, California, United States
On-site
Competitive Salary + Equity

Apply with RefersoAI Apply on careers page

We are looking for an ML Systems Engineer to help build and optimize the core serving infrastructure behind Agent Cloud.

Responsibilities

Optimize large-scale LLM inference and serving systems.
Improve total tokens per second, decode tokens per second, latency, throughput, and cost efficiency.
Work on serving infrastructure for open-source models across different types of accelerators.
Improve batching, scheduling, KV cache management, memory usage, and accelerator utilization.
Support long-context inference, including workloads targeting up to 1M context.

Skills

ML systems distributed systems high-performance computing optimizing inference or training workloads for large models TPUs GPUs accelerators CUDA Triton

Senior Data Scientist

BMC Software · Posted Nov 5, 2026

Open

Remote, Poland
Remote
Full-time · Senior
PLN 251K–PLN 418K per year
8+ years

Apply with RefersoAI Apply on careers page

Lead complex AI/ML initiatives, design, develop, evaluate, and operationalize enterprise AI solutions, mentor junior data scientists, and collaborate across engineering and product teams.

Compensation

The range listed is just one component of BMC's employee compensation package. The annual base salary range represents the low and high end of the BMC salary range for this position. Actual salaries depend on a wide range of factors that are considered in making compensation decisions, including but not limited to skill sets; experience and training, licensure, and certifications; other business and organizational needs. The range listed is zł 251,025 - zł 418,375

Responsibilities

Design and develop AI/ML solutions
Evaluate and operationalize models
Mentor junior data scientists
Collaborate with AI Engineering and Platform Engineering
Lead technical decisions

Requirements

Bachelor’s degree in Machine Learning, Statistics, Data Science, Physics, Computer Science, or a related field
Nice to have: OpenSearch
Nice to have: Elasticsearch
Nice to have: FAISS
Nice to have: Milvus

Skills

Python Pandas NumPy scikit-learn PyTorch

AI Framework and Performance Experts(vLLM, SGLang)

AI Framework and Performance Experts(vLLM, SGLang)

Responsibilities

Requirements

Skills

Benefits

Research Intern — Neural Network Training and Hardware–Software Co-Design

Responsibilities

Requirements

Skills

Founding Machine Learning Infrastructure Engineer

Responsibilities

Skills

Senior Data Scientist

Compensation

Responsibilities

Requirements

Skills

Benefits