Jobs Referso Partner API

Free job alerts

ML inference optimization jobs

Job titleLocation

Popular:United States Canada Viet Nam

All filtersRefine by skill, company, date, job type, industry and more

Company

Skillsjobs that use all of them

ML inference optimization

Popular

Date posted

Any timePast hourPast 24 hoursPast week

Workplace

RemoteHybridOn-site

Job type

Full-timePart-timeContractInternshipTemporary

Experienceyears required

0–2 years2–5 years5–10 years10+ years

Salary

Salary listed

Education

High schoolAssociate degreeBachelor's degreeProfessional certificatePostgraduate degree

Industryfield of work

Software & InternetHardware & ElectronicsEngineeringHealthcareLife Sciences & ResearchFinance & AccountingSales & Business DevelopmentMarketing & CommunicationsCreative & DesignCustomer Service & SupportAdministrative & OfficeHuman Resources & RecruitingLegal & ComplianceManagement & OperationsEducation & TrainingRetailHospitality & Food ServiceManufacturing & ProductionSkilled Trades & ConstructionTransportation & LogisticsFacilities, Cleaning & SecuritySocial Services & Public SectorEnergy, Environment & Agriculture

1 selected

Skill:ML inference optimization

Referso Jobs

Fresh jobs from employer career sites in the US and Europe. Search free, get alerts free, and let Referso apply when you're ready.

Job seekersSearch jobs Free job alerts Remote jobs

RefersoAuto-apply How it works Pricing Log in

For companiesPartner API (beta)API docs Contact sales

CompanyAbout Contact Privacy Terms

© 2026 Referso. Jobs link to the original posting; Referso is not affiliated with the employers listed.Privacy Terms Request a removal

1–1 jobs· newest first

Senior Machine Learning Engineer, Inference
AIDA Recruitment · Mountain View, US+5 more
$250K–$300KHybrid · Full-time · SeniorVisa

+10K new in the last hour

Senior Machine Learning Engineer, Inference

AIDA Recruitment · Posted Nov 5, 2026

Mountain View, California, United States +5 more
Hybrid
Full-time · Senior
$250K–$300K per year
5+ years
Visa sponsorship

Apply with RefersoAI Apply on careers page

Senior Machine Learning Engineer focused on ML inference optimization for realtime voice and LLM technology.

Locations (6)

Mountain View, California, United States
Canada
United Kingdom
Germany
Switzerland

Serbia

Compensation

Salary: $250K–$300K base + competitive equity

Responsibilities

Own inference optimization end-to-end, from research to production deployment
Optimize latency and throughput of realtime voice and LLM inference at consumer scale
Work inside inference engines such as vLLM, TRT-LLM and SGLang
Apply model acceleration techniques – quantization, distillation, speculative decoding, caching, continuous batching and paged attention
Write high-performance code in C++, CUDA, Rust or optimized Python for GPU workloads

Requirements

PhD in Computer Science, Physics or Mathematics, or a degree from a top CS program
Nice to have: open-source inference engine contributions
Nice to have: technical write-ups

Skills

ML inference optimization C++CUDA Rust Python vLLM TRT-LLM SGLang Kubernetes Ray quantization distillation speculative decoding continuous batching paged attention

Benefits

competitive equity
relocation assistance to the San Francisco Bay Area

See full job description