Staff Software Engineer, AI Inference
Syllo · Posted Jul 13, 2026
- Remote, United States
- Remote
- Full-time · Senior
- $190K–$230K per year
Lead the design and development of our production inference platform and define the technical roadmap for inference infrastructure, model serving, and runtime optimization.
Compensation
Salary Range ($190- $230K) plus health insurance and equity. United States - Remote Pay Range $190,000—$230,000 USD
Responsibilities
- Lead the design and development of our production inference platform
- Define the technical roadmap for inference infrastructure, model serving, and runtime optimization
- Build and operate scalable, cost-effective systems for serving large language models in production
- Evaluate and integrate modern inference technologies, frameworks, and serving runtimes
- Optimize latency, throughput, GPU utilization, memory efficiency, and infrastructure cost