Data Annotation Specialist - AI Lab
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Generalist Type:Contract Compensation:$50/hour Location:Remote Role Responsibilities
- Review, evaluate, and annotate AI outputs with extreme attention to detail.
- Follow complex guidelines precisely and apply them consistently across tasks.
- Identify subtle errors, edge cases, and quality issues others might miss.
- Provide clear, structured feedback to improve downstream AI training quality.
- Maintain high accuracy across repetitive, high-volume workflows.
- Flag unclear instructions or ambiguous cases proactively.
Qualifications
Must-Have
- Exceptionally detail-oriented and quality-obsessed mindset.
- Prior experience as a CB / reviewer / rater in human data or AI training pipelines.
- Proven ability to follow nuanced instructions without deviation.
- Strong written communication and reasoning skills.
- High reliability, consistency, and comfort with repetitive precision work.
- Ability to work independently and maintain focus over long task batches.
Preferred
- Experience with large-scale AI data annotation or evaluation programs.
- Background in QA, operations, trust & safety, or structured review work.
- Familiarity with multi-step rubric-based evaluations.
- Comfort giving calibrated feedback aligned with strict quality bars.
Compensation & Legal
- Hourly contractor
- Paid weekly via Stripe Connect
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: [email protected]
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. Apply To This Job