Talent.com
Generative AI STEM Evaluator

Generative AI STEM Evaluator

AceolutionRepublic Of India, IN
30+ days ago
Job description

STEM Raters for GenAI Data

Role Overview

As a STEM Rater for [Maths / Physics / Chemistry / Biology / Coding / Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your primary responsibility will be to meticulously create, review, and refine high-quality data. This involves evaluating AI responses for accuracy, clarity, and pedagogical effectiveness, ensuring they are insightful, well-structured, and tailored to the learner's level. You will apply your deep subject matter expertise to provide critical feedback that directly enhances the AI's ability to teach millions at scale through technology.

Profile of the Ideal Candidate

I. Core Responsibilities

High-Quality Data Creation & Curation :

  • Meticulously create and refine high-quality data, including detailed solutions, explanations, and step-by-step derivations for STEM problems across various difficulty levels.
  • Ensure all content adheres strictly to established quality rubrics, style guides, and pedagogical standards, focusing on accuracy, clarity, and effectiveness.
  • Integrate subject matter expertise to provide comprehensive and insightful explanations that anticipate common student misconceptions.

AI Response Evaluation & Feedback :

  • Rigorously evaluate AI-generated responses for correctness, coherence, pedagogical soundness, and adherence to specific instructions.
  • Provide clear, constructive, and actionable feedback to the AI model, identifying errors, inaccuracies, or areas for improvement in its reasoning and presentation.
  • Participate in creating "ground truth" solutions and evaluation datasets to benchmark AI model performance.
  • Subject Matter Expertise Application :

  • Apply deep knowledge in [Maths / Physics / Chemistry / Biology / Coding / Finance] to assess complex problems, verify solutions, and develop alternative approaches.
  • Stay updated with advancements and common curriculum standards in your respective STEM field to ensure content relevance and accuracy.
  • Collaboration & Workflow Adherence :

  • Work closely with the STEM Lead and fellow raters to ensure consistency in data creation and evaluation processes.
  • Adhere to established workflows, deadlines, and project requirements set by the STEM Lead.
  • Communicate clearly about challenges encountered in data creation or AI evaluation to facilitate timely resolution.
  • II. Required Qualifications & Experience

  • Educational Background : A Master's degree (M.Sc. / M.Tech) in [Maths / Physics / Chemistry / Biology / Coding / Finance] or a closely related field from a premier Tier-1institution (e.G., IIT, BITS, NIT,IISER, IISc, TIFR, CMI, eminent central universities) is required. A Ph.D. is a plus. Demonstrable academic excellence is very important, either during the course or in a national level competitive examination at any level
  • Deep Subject Expertise : Demonstrable, strong expertise across a wide range of topics within your subject, covering syllabi for competitive exams (e.G., JEE Mains & Advanced / NEET / GATE) and major undergraduate curricula. Excellent conceptual understanding with the ability to solve all Previous Years' Questions (PYQs) of JEE Advanced / NEET / GATE as well as generally tough undergraduate, graduate level problems in your subject.
  • Teaching / Content Creation Experience : Proven experience (7+ years) in teaching, tutoring, content writing, or academic research in your specialized STEM field. Experience with competitive exam preparation is highly valued.
  • Exceptional Communication Skills : Excellent written communication skills with the ability to explain complex concepts clearly, concisely, and accurately.
  • III. Preferred Qualifications (The "Ideal" Candidate)

  • Proven track record of producing top 100 rankers in JEE Advanced or NEET or GATE
  • Content Development : Expertise in developing high-quality, original problems of JEE Advanced and / or Olympiad level and / or GATE. Experience authoring personal teaching materials, notes, and question banks is highly desirable
  • Experience with AI / ML Feedback : Familiarity with providing structured feedback for AI models or large language models.
  • IV. Personal Attributes & Soft Skills

  • Meticulous & Detail-Oriented : An unwavering commitment to accuracy, a keen eye for minute details, and a high standard for quality.
  • Pedagogical Aptitude : A natural ability to explain concepts in an easy-to-understand, step-by-step manner, considering different learning styles.
  • Analytical & Critical Thinker : Capable of critically evaluating information, identifying logical flaws, and applying analytical reasoning to solve problems.
  • Organized, Efficient & Proactive : Able to manage time effectively, prioritize tasks, and consistently meet deadlines in a fast-paced environment. Be a proactive self starter who can problem solve to resolve roadblocks rather than (largely) relying on external support
  • Collaborative & Dynamic : Works well in a team setting, is open to receiving and incorporating feedback, and is dedicated to continuous improvement. Comfortably to execute in a continuously changing environment
  • Tech-Savvy : Be extremely comfortable using Google Workspace and collaborate real-time with other stakeholders to deliver the end-goal (data points). Highly amenable to working with new tools and platforms for content creation and AI interaction.
  • Create a job alert for this search

    Generative Ai • Republic Of India, IN

    Related jobs
    • Promoted
    AI Exploration Engineer

    AI Exploration Engineer

    Mitchell Martin Inc.India, India
    Design and execute machine learning experiments to evaluate emerging AI technologies and frameworks.Prototype and assess end-to-end AI solutions to inform product and platform strategy.Formulate hy...Show moreLast updated: 30+ days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    goMLRepublic Of India, IN
    Looking for a culture to thrive & build a rewarding career for yourself, join the core team of young hustlers building the next generation of Machine Learning platform & services.You will develop t...Show moreLast updated: 30+ days ago
    • Promoted
    Gen AI Engineer

    Gen AI Engineer

    ADPnagpur, maharashtra, in
    We are seeking a highly skilled and experienced Senior Generative AI Engineer to lead the development of intelligent agents powered by advanced generative AI models. In this role, you will be respon...Show moreLast updated: 18 days ago
    • Promoted
    Ai Exploration Engineer

    Ai Exploration Engineer

    Mitchell Martin Inc.Republic Of India, IN
    Design and execute machine learning experiments to evaluate emerging AI technologies and frameworks.Prototype and assess end-to-end AI solutions to inform product and platform strategy.Formulate hy...Show moreLast updated: 30+ days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    AnswerThis (YC F25)Republic Of India, IN
    Remote (Applications open worldwide).Semantic Search, Vector Databases, Prompt Engineering, GenAI Frameworks, React Agents, Graph Agents, Document Parsing, Python, Scalable APIs.AnswerThis is an AI...Show moreLast updated: 30+ days ago
    • Promoted
    Applied AI Engineer

    Applied AI Engineer

    ValeoChennai, Republic Of India, IN
    Research, develop, benchmark, test and document state of the art algorithms for autonomous driving.Research new vision and other sensor technology, ideas, and approaches. Support Intellectual Proper...Show moreLast updated: 21 days ago
    • Promoted
    Generative AI Solutions Engineer

    Generative AI Solutions Engineer

    BharatGenRepublic Of India, IN
    As an AI Full Stack Developer, you will have the opportunity to build end-to-end applications that leverage generative AI models and agentic architectures to address real-world business needs acros...Show moreLast updated: 21 days ago
    • Promoted
    Generative AI Solutions Engineer

    Generative AI Solutions Engineer

    Persistent SystemsPune, Republic Of India, IN
    We are seeking a Generative AI Engineer to design and build intelligent systems using state-of-the-art generative models. You will work on developing applications powered by large language models (L...Show moreLast updated: 30+ days ago
    • Promoted
    Applied AI Engineer

    Applied AI Engineer

    AnswerThis (YC F25)Republic Of India, IN
    Remote (Applications open worldwide).Semantic Search, Vector Databases, Prompt Engineering, GenAI Frameworks, React Agents, Graph Agents, Document Parsing, Python, Scalable APIs.AnswerThis is an AI...Show moreLast updated: 30+ days ago
    • Promoted
    AI Technology Evaluation Engineer

    AI Technology Evaluation Engineer

    Mitchell Martin Inc.Republic Of India, IN
    Design and execute machine learning experiments to evaluate emerging AI technologies and frameworks.Prototype and assess end-to-end AI solutions to inform product and platform strategy.Formulate hy...Show moreLast updated: 30+ days ago
    • Promoted
    Cerebry — GenAI Implementation Engineer (AI Growth Lead)

    Cerebry — GenAI Implementation Engineer (AI Growth Lead)

    Cerebrynagpur, maharashtra, in
    Transform Cerebry Research designs into.Architect, code, evaluate, and package GenAI services that power Cerebry end-to-end. Why this is exciting (Ownership-Forward).Initial grants are designed for ...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    QX Labsnagpur, maharashtra, in
    QX Labs is looking for a full stack AI engineer with a strong software background to join our expanding team of AI experts. We are an early-stage London-based startup building cutting-edge workflow ...Show moreLast updated: 13 days ago
    • Promoted
    AI System Evaluation Engineer

    AI System Evaluation Engineer

    BharatGenRepublic Of India, IN
    We are looking for an AI Evaluation & Test Engineer to join our growing team to ensure that our generative AI models and applications are safe, accurate, trustworthy, and deliver an elegant user ex...Show moreLast updated: 13 days ago
    • Promoted
    Responsible AI

    Responsible AI

    EXLIndia, India
    We are seeking a highly skilled and principled Responsible AI Evaluator to assess, audit, and ensure the ethical development and deployment of AI models across the enterprise.This role spans tradit...Show moreLast updated: 30+ days ago
    • Promoted
    AI Systems Evaluation Engineer (Remote)

    AI Systems Evaluation Engineer (Remote)

    TaskifyRepublic Of India, IN
    Remote
    We're Hiring "Software Engineers (Freelance / Remote)" | Earn up to $2500 per month.Join a global community of talented writers to shape the future of AI. Contribute to training and refining cutting-e...Show moreLast updated: 21 days ago
    • Promoted
    Applied AI Engineer

    Applied AI Engineer

    EXLPune, Republic Of India, IN
    Design and implement modular, reusable AI agents capable of autonomous decision-making using LLMs, APIs, and tools like LangChain, AutoGen, or Semantic Kernel. Engineer prompt strategies for task-sp...Show moreLast updated: 18 days ago
    • Promoted
    Generative AI Engineer (LLM Expert – AWS Focus)

    Generative AI Engineer (LLM Expert – AWS Focus)

    BigRioNagpur, IN
    Job Title : Generative AI Engineer (LLM Expert – AWS Focus).Employment Type : Ongoing Contract.Boston-based, remote-first technology consulting firm. We partner with forward-thinking organizations to ...Show moreLast updated: 12 days ago
    • Promoted
    AI Prototyping Engineer

    AI Prototyping Engineer

    Mitchell Martin Inc.Republic Of India, IN
    Design and execute machine learning experiments to evaluate emerging AI technologies and frameworks.Prototype and assess end-to-end AI solutions to inform product and platform strategy.Formulate hy...Show moreLast updated: 30+ days ago