Software Engineer, AI Infrastructure
Design and build the backend platform that runs software-writing agents, covering how work is matched to models, how agents receive context, how their behaviour is measured, and how engineers can see what happened. The role combines production engineering with applied research aimed at making these systems better over time.
- San Francisco, California, United States
- Full-time
- Hybrid
- $220K–$350K per year
- Posted Nov 19, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareAI & Machine Learning
Responsibilities
- Decide which model handles each task, weighing cost, speed and quality, and measure whether those choices were right
- Shape what information reaches each model by designing lookup, state handling and condensing techniques, keeping only what is pertinent
- Design evaluations that show where to improve next and whether a change made agents better
- Build observability tools that record what each agent did, why, and at what cost
- Use logged runs to improve the system through new tools, cheaper learned behaviour and fixes for recurring failures
- Design how code and its history are represented, stored and versioned when agents produce much of it
Requirements
- Top undergraduate STEM degree
- Experience in a early-stage startup
Nice to have: Program correctness, Language design, Model fine-tuning, Developer infrastructure experience, Experience at a coding-agent company or on an internal coding-agent platform
Skills
Production backend or infrastructure experienceScaling servicesAutoscalingIsolationObservabilityFounder, founding engineer or similar fast-paced 0 to 1 development experienceversion controlbuild systems
Benefits
- Health, dental and vision coverage
- Flexible time off
- Retirement plan
More jobs nearby
Full description
Company details are for members
Sign up for a free job alert to see Raydar's profile, website and LinkedIn, and the same for every employer on Referso Jobs.