- Mountain View, California, United States
- On-site
- Full-time · Senior
- $147K–$210K per year
- 2+ years
Manage the practical issues of benchmarking foundation models for robotics, designing evaluation protocols, tooling, and frameworks to extract meaningful signals from physical policy execution.
Compensation
US: $147000 - $210000 (USD) + 15% bonus target + equity + benefits
Responsibilities
- Design, implement, and maintain scalable, frameworks to enable evaluation of robot policies across offline open-loop testing and real-world hardware evaluations.
- Partner with researchers to design the content of various benchmarks in order to maximize evaluation signal and stress-test model capabilities.
- Build diagnostic and visualization tools that allow the team to easily root-cause policy failures and track performance regressions.
- Establish evaluation criteria for model releases and own the stability and benchmarking of models slated for critical demos.
- Innovate on how to make real-world hardware evaluation faster, more reproducible, and less reliant on manual human intervention.
Requirements
- Bachelor’s degree in Computer Science
- Bachelor’s degree in Robotics
- Nice to have: ROS/ROS2
- Nice to have: On-device deployment constraints
- Nice to have: Multimodal datasets
