Staff Software Engineer, AI Inference
Syllo · Posted Jul 13, 2026
- Remote, United States
- Remote
- Full-time · Staff
- $190K–$230K per year
Spearhead the effort to build and optimize the AI inference stack to deliver best-in-class performance, reliability, cost efficiency, and flexibility across the latest generation of open-source language models.
Compensation
$190- $230K) plus health insurance and equity. United States - Remote Pay Range $190,000—$230,000 USD
Responsibilities
- Lead the design and development of our production inference platform.
- Define the technical roadmap for inference infrastructure, model serving, and runtime optimization.
- Build and operate scalable, cost-effective systems for serving large language models in production.
- Evaluate and integrate modern inference technologies, frameworks, and serving runtimes.
- Optimize latency, throughput, GPU utilization, memory efficiency, and infrastructure cost.