- Singapore, Singapore
- On-site
- 6+ years
Build and maintain evaluation rubrics for image and video generation quality, execute human evaluation rounds, and support the transition of human judgment into automated measurement for generative media models.
Responsibilities
- Build and maintain evaluation rubrics for image and video generation quality
- Execute human evaluation rounds on model output
- Construct and curate prompt sets and golden sets
- Calibrate with fellow raters and vendor teams
- Partner with research and modeling teams to translate eval findings into training and post-training signal
Requirements
- Bachelor's degree in a directly related field, or equivalent practical experience