STEM Content Evaluation Specialist (GenAI)

STEM Raters for GenAI Data

Freelancing & Remote

Part time (25 Hours a MUST)

Role Overview

As a STEM Rater for [Maths / Physics / Chemistry / Biology / Coding / Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your primary responsibility will be to meticulously create, review, and refine high-quality data. This involves evaluating AI responses for accuracy, clarity, and pedagogical effectiveness, ensuring they are insightful, well-structured, and tailored to the learner's level. You will apply your deep subject matter expertise to provide critical feedback that directly enhances the AI's ability to teach millions at scale through technology.

Profile of the Ideal Candidate

I. Core Responsibilities

• High-Quality Data Creation & Curation :
• Meticulously create and refine high-quality data, including detailed solutions, explanations, and step-by-step derivations for STEM problems across various difficulty levels.
• Ensure all content adheres strictly to established quality rubrics, style guides, and pedagogical standards, focusing on accuracy, clarity, and effectiveness.
• Integrate subject matter expertise to provide comprehensive and insightful explanations that anticipate common student misconceptions.
• AI Response Evaluation & Feedback :
• Rigorously evaluate AI-generated responses for correctness, coherence, pedagogical soundness, and adherence to specific instructions.
• Provide clear, constructive, and actionable feedback to the AI model, identifying errors, inaccuracies, or areas for improvement in its reasoning and presentation.
• Participate in creating "ground truth" solutions and evaluation datasets to benchmark AI model performance.
• Subject Matter Expertise Application :
• Apply deep knowledge in [Maths / Physics / Chemistry / Biology / Coding / Finance] to assess complex problems, verify solutions, and develop alternative approaches.
• Stay updated with advancements and common curriculum standards in your respective STEM field to ensure content relevance and accuracy.
• Collaboration & Workflow Adherence :
• Work closely with the STEM Lead and fellow raters to ensure consistency in data creation and evaluation processes.
• Adhere to established workflows, deadlines, and project requirements set by the STEM Lead.
• Communicate clearly about challenges encountered in data creation or AI evaluation to facilitate timely resolution.

II. Required Qualifications & Experience

III. Preferred Qualifications (The "Ideal" Candidate)