About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position : AI Research Evaluator
Type : Contractor
Compensation : $20–$30 / hour
Location : Remote
Commitment : 30–40 hours / week
Role Responsibilities
- Review and audit submitted data, including prompts, solutions, final answers, references, and metadata.
- Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency.
- Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, identifying flaws, gaps, or inconsistencies.
- Provide concise, well-reasoned written feedback to justify evaluation decisions.
- Work independently and asynchronously following provided tools and workflows.
Qualifications
Must-Have
PhD (or current PhD candidacy) or Master's in Mathematics, Computer Science, Applied Mathematics, or a related STEM field.Expertise in one or more domains, including Mathematics : algebra, geometry, number theory, combinatorics, probability, graph theory.Strong analytical skills with the ability to evaluate multi-step reasoning.Excellent written communication and attention to detail.Ability to work independently in a fully remote environment.Preferred
Basic knowledge of Python and testing frameworks (e.g., Pytest, JUnit).Compensation & Legal
Contractor position via Mercor, paid hourly.Competitive rates based on expertise : $20–$30 / hour.Weekly payments processed securely through Stripe Connect.Application Process (Takes 20–30 mins to complete)
Upload resumeAI interview based on your resumeSubmit formResources & Support
For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcomeFor any help or support, reach out to : [HIDDEN TEXT]PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Skills Required
Computer Science, Mathematics, Applied Mathematics, Python