Member of Technical Staff
True Talent Solutions Partners · Posted Nov 16, 2026
- San Francisco, California, United States
- On-site
- Full-time
- $200K–$300K per year
- 1–6 years
- Visa sponsorship
Ship support for new open-source models, tuning them for latency and throughput; optimize inference serving; write and tune kernels; design, deploy, and operate heterogeneous clusters; run production inference; work with customers to understand technical needs and solve infrastructure problems.
Compensation
Base salary: $200,000 to $300,000 annually. Visa sponsorship is available.
Responsibilities
- Ship support for new open-source models, tuning them for latency and throughput.
- Optimize inference serving with techniques such as batching, KV caching, speculative decoding, and quantization.
- Write and tune kernels using CUDA, HIP, and Triton across a range of accelerator platforms.
- Design, deploy, and operate heterogeneous clusters across infrastructure vendors.
- Run production inference across a mixed hardware fleet, improving reliability, observability, and cost efficiency.