Distributed Inference jobs

Research Intern — Neural Network Training and Hardware–Software Co-Design

Meta · Posted Nov 10, 2026

Open

Burlingame, California, United States
On-site
Internship · Intern

Apply with Referso

Research Intern — Neural Network Training and Hardware–Software Co-Design

Meta · Posted Nov 10, 2026

Open

Burlingame, California, United States
On-site
Internship · Intern

Apply with Referso

Founding Machine Learning Infrastructure Engineer

Peano AI · Posted Jun 16, 2026

Open

Palo Alto, California, United States
On-site
Competitive Salary + Equity

Apply with RefersoAI Apply on careers page

We are looking for an ML Systems Engineer to help build and optimize the core serving infrastructure behind Agent Cloud.

Responsibilities

Optimize large-scale LLM inference and serving systems.
Improve total tokens per second, decode tokens per second, latency, throughput, and cost efficiency.
Work on serving infrastructure for open-source models across different types of accelerators.
Improve batching, scheduling, KV cache management, memory usage, and accelerator utilization.
Support long-context inference, including workloads targeting up to 1M context.

Skills

ML systems distributed systems high-performance computing optimizing inference or training workloads for large models TPUs GPUs accelerators CUDA Triton

Senior Data Scientist

BMC Software · Posted Nov 5, 2026

Open

Remote, Poland
Remote
Full-time · Senior
PLN 251K–PLN 418K per year
8+ years

Apply with RefersoAI Apply on careers page

Lead complex AI/ML initiatives, design, develop, evaluate, and operationalize enterprise AI solutions, mentor junior data scientists, and collaborate across engineering and product teams.

Compensation

The range listed is just one component of BMC's employee compensation package. The annual base salary range represents the low and high end of the BMC salary range for this position. Actual salaries depend on a wide range of factors that are considered in making compensation decisions, including but not limited to skill sets; experience and training, licensure, and certifications; other business and organizational needs. The range listed is zł 251,025 - zł 418,375

Responsibilities

Design and develop AI/ML solutions
Evaluate and operationalize models
Mentor junior data scientists
Collaborate with AI Engineering and Platform Engineering
Lead technical decisions

Requirements

Bachelor’s degree in Machine Learning, Statistics, Data Science, Physics, Computer Science, or a related field
Nice to have: OpenSearch
Nice to have: Elasticsearch
Nice to have: FAISS
Nice to have: Milvus

Skills

Python Pandas NumPy scikit-learn PyTorch

Distributed Inference jobs

Responsibilities

Requirements

Skills

Responsibilities

Skills

Compensation

Responsibilities

Requirements

Skills

Benefits