Use mathematical expertise and programming skills to create challenging technical tasks, evaluate model-generated code and reasoning, identify failures, and establish objective standards for correct solutions.
Compensation is output-based. Experts are paid for tasks that meet project specifications and quality requirements. Task availability and completion time may vary.
- Create realistic computational mathematics and statistics tasks that challenge advanced AI models
- Develop task instructions, reproducible environments, reference solutions, and evaluation criteria
- Evaluate model-generated proofs, calculations, code, models, optimizations, and technical deliverables
- Identify logical errors, invalid assumptions, numerical instability, incorrect statistical methods, or reproducibility failures
- Master’s degree, PhD, or equivalent record of substantial computational work
- Nice to have: Creating AI-training tasks, reference answers, rubrics, graders, or benchmark problems
- Nice to have: Reviewing other AI trainers’ technical submissions
- Nice to have: NumPy
- Nice to have: SciPy