- Remote, United States +1 more
- Remote
- Full-time · Senior
- $184K–$357K per year
- 8+ years
Senior Software Engineer to help build the core libraries, evaluation systems, and reusable harness capabilities that make AI agents safer, faster, and easier for developers to trust.
Locations (2)
- United States, United States
- Canada, Canada
Compensation
The expected base salary ranges for this position are: 184,000 USD – 287,500 USD for Level 4; and 224,000 USD – 356,500 USD for Level 5.
Responsibilities
- Define and evolve the technical approach for evaluating and improving open agent harnesses across frameworks, models, and benchmark environments.
- Build and operate scalable, reproducible evaluation systems spanning CI, scheduled compute, sandboxed execution, artifact provenance, trace capture, and analysis.
- Diagnose agent failures from traces, logs, tool results, and benchmark artifacts, separating harness, evaluator, environment, inference, and model causes.
- Design controlled experiments and promotion criteria that distinguish genuine harness improvements from noise, benchmark artifacts, or model-specific gains.