- Remote, United States
- Remote
- Manager
- $160K–$220K per year
Lead TPA's evaluation and scoring work for AI Proving Grounds, managing software engineers and data scientists, implementing and debugging software, and owning delivery.
Compensation
Base salary range: $160,000 - $220,000, reflecting our confidence in your expertise and impact, with the opportunity for annual bonuses tied to company performance and individual contributions.
Responsibilities
- Hire, coach and develop software engineers and Data Scientists
- Define assessment questions, reference cases, evidence requirements and acceptance criteria
- Lead delivery from execution coordination through evidence capture, scoring and usable results
- Review architecture and code with the Staff Engineer
- Build tests for missing evidence, incompatible versions, interrupted runs and misleading results
Requirements
- Nice to have: agent evaluation
- Nice to have: experimentation
- Nice to have: scoring
- Nice to have: scientific software
- Nice to have: data processing