- Remote
- Remote
- Senior
- $50–$120 per hour
- 5+ years
Join a remote expert network as a senior rater and reviewer, evaluating complex AI model outputs and helping calibrate other graders.
Compensation
Compensation is $50 to $120 per hour, depending on the project, field, and expertise level. Payment is based on hours worked.
Responsibilities
- Rank and rate expert-level model answers using detailed rubrics and write clear rationales.
- Evaluate steps in model reasoning across fields such as mathematics, coding, law, medicine, and finance.
- Fact-check complex claims against primary sources and verify accuracy.
- Assess answers against content policies, style guides, and edge cases.
- Review other raters' work, calibrate standards, and develop or refine grading guidelines.
Requirements
- Advanced degree
- Professional license
- Nice to have: Deep domain expertise
