Company Introduction
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Role Overview
- Position : Writing Expert – Freelance, Remote
- Commitment : 20 hours per week, Duration : 1 month
- Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.
Responsibilities
Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop comprehensive rubric.Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.Requirements / Qualifications
Must-Have Qualifications
BS or BA from a reputable institution completed or in progressStrong writing and critical thinking skillsAbility to work independently and meet deadlinesSignificant familiarity with ChatGPT or similar tools for personal decision-making or hobbies / general interestsPreferred Qualifications
2+ years of experience in teaching or researchEngagement Details
Remote and asynchronous role20 hours per week commitmentDuration : 1 monthApplication Process (Takes 20-30 mins to complete)
Complete an AI-led interview, this should take around 15 minutesComplete a 45-minute written assessment that will guide you through writing rubricsIf selected, you will be invited to work on the projectResources & Support
For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcomeFor any help or support, reach out to : [HIDDEN TEXT]PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Skills Required
Critical Thinking, Writing