Staff Software Engineer, AI Inference
Syllo · Posted Jul 13, 2026
- Remote, United States
- Remote
- Full-time · Staff
- $190K–$230K per year
Looking for a Staff Software Engineer to spearhead the investment in an inference stack to deliver best-in-class performance, reliability, cost efficiency, and flexibility across open-source language models.
Compensation
Salary Range ($190- $230K) plus health insurance and equity. United States - Remote Pay Range: $190,000—$230,000 USD
Responsibilities
- Lead the design and development of our production inference platform.
- Define the technical roadmap for inference infrastructure, model serving, and runtime optimization.
- Build and operate scalable, cost-effective systems for serving large language models in production.
- Evaluate and integrate modern inference technologies, frameworks, and serving runtimes.
- Optimize latency, throughput, GPU utilization, memory efficiency, and infrastructure cost.