- Remote, United States
- Remote
- Contract · Staff
- $70–$100 per hour
- 4+ years
Contribute to shaping the evaluation standards for next-generation AI-generated video models by evaluating AI-generated videos based on professional execution across filmmaking and visual production parameters.
Compensation
Compensation: $70 - $100 per hour
Responsibilities
- Compare pairs of AI-generated videos created from identical prompts and assess their quality across specific filmmaking and visual production parameters
- Identify the stronger video based on professional production standards and demonstrate sound judgment across relevant creative and technical disciplines
- Provide concise, specific explanations for evaluation decisions, highlighting successful elements, technical shortcomings, and areas where the output fails to meet professional expectations
- Assess how accurately each generated video follows its original prompt
- Evaluate visual consistency, cinematic quality, character performance, editing choices, and overall production execution
Requirements
- Professional or graduate-level experience in at least one relevant film, theatre, animation, visual effects, or post-production discipline
- Nice to have: Professional proficiency in an additional dubbing language (French, Italian, German, Spanish, Portuguese, Korean, or Hindi)
- Nice to have: Experience evaluating cinematic content
- Nice to have: Experience reviewing production footage