Member of Technical Staff
True Talent Solutions Partners · Posted Nov 10, 2026
- San Francisco, California, United States
- On-site
- Full-time · Mid
- $200K–$300K per year
- 1–6 years
- Visa sponsorship
Build and operate AI infrastructure systems for large language model inference.
Compensation
Base salary: $200,000 to $300,000 annually. Visa sponsorship is available.
Responsibilities
- Ship support for new open-source models, tuning them for latency and throughput.
- Optimize inference serving systems, including batching, KV cache, speculative decoding, and quantization.
- Write and tune kernels using CUDA, HIP, and Triton for a range of accelerator architectures.
- Design, deploy, and operate heterogeneous clusters across hardware and cloud vendors.
- Run production inference systems, improving reliability, observability, and cost efficiency.