Company Introduction
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Role Overview
- Position : STEM Expert – Contract, Remote
- Commitment : 20 hours per week, Duration : 1 month
- Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry.
Responsibilities
Design and Optimize STEM-Based Prompts : Create detailed prompts with multiple constraints and scientific instructions.Define and Document Evaluation Standards : Establish high-level expectations for correct responses in STEM contexts and develop a comprehensive rubric.Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific rigor, maintaining consistency and reliability before integration into official benchmarks.Requirements / Qualifications
Must-Have Qualifications
BS or BA in Biology, Physics, or ChemistryFamiliarity with undergraduate-level biology, physics, chemistry topicsStrong writing and critical thinking skillsAbility to work independently and meet deadlinesPreferred Qualifications
2+ years of experience in teaching, research, or applied STEM discipline fieldEngagement Details
Remote and asynchronous role20 hours per week commitmentDuration : 1 monthStructured project environment with clear goals and toolsApplication Process (Takes 20-30 mins to complete)
Complete an AI-led interview, this should take around 15 minutesComplete a 45-minute written assessment that will guide you through writing rubricsIf selected, you will be invited to work on the projectResources & Support
For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcomeFor any help or support, reach out to : [HIDDEN TEXT]PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Skills Required
Physics, Critical Thinking, Chemistry, Biology, Writing