Full-Stack Engineer, Agent Evaluation & Reliability
True Talent Solutions Partners · Posted Nov 9, 2026
- San Francisco, California, United States
- On-site
- Full-time · Mid
- $120K–$180K per year
- 2–4 years
- Visa sponsorship
Build and maintain backend systems that power agent evaluation and continuous improvement, design data models, develop enterprise integrations, own features end to end, work directly with customers, debug distributed workflows and improve system reliability.
Compensation
Base salary is $120,000 to $180,000 USD annually. Visa sponsorship is available, including H-1B transfers, OPT, and O-1.
Responsibilities
- Build and maintain backend systems that power agent evaluation and continuous improvement.
- Design data models for evaluation datasets, experiment runs, agent traces, knowledge versions, findings, and customer-defined quality criteria.
- Develop and support enterprise integrations, including authentication, OAuth, webhooks, incremental syncs, backfills, rate limits, retries, and monitoring.
- Own features end to end, from technical design and implementation through deployment, observability, customer feedback, and iteration.
- Work directly with customers to diagnose system failures and turn individual needs into reusable product capabilities.