We are looking for a detail-oriented QC Reviewer to ensure the quality and consistency of robot manipulation video annotations produced by our annotation team.
What You'll Do :- Review completed annotations of robot manipulation videos across three levels of labeling detail (atomic motion, skill/subtask, task/goal).
- Cross-check annotator descriptions against all three camera views (overhead and both wrist-mounted cameras) to verify accuracy of described actions, object identification, and contact/grasp details.
- Verify full coverage of each video — confirm there are no gaps in labeling, including idle or pause moments.
- Check that descriptions accurately reflect what actually happened in the video, including failures, drops, or slipped grips — flagging any instances where outcomes were inaccurately described or "smoothed over."
- Evaluate annotations for adherence to the style guide: correct vocabulary usage, spatial/directional accuracy, consistent terminology for objects and actions, and appropriate language variation (avoiding repetitive phrasing).