Talent.com
Language Model Evaluation Analyst

Language Model Evaluation Analyst

TuringKolkata, Republic Of India, IN
21 hours ago
Job description

About the Role :

Join us as an Research Analyst and help shape the future of large language models (like GPT). You’ll work on fascinating analytical questions, research real-world scenarios, and create structured content that improves how AI understands and responds. No AI experience is required—just strong English skills, sharp reasoning, and curiosity.

What You’ll Do :

  • Read, analyze, and break down large content into smaller logical blocks.
  • Validate claims and conduct online research to ensure accuracy.
  • Create puzzles, scenarios, and tricky questions to train AI models.
  • Provide clear, structured feedback to fine-tune responses
  • Collaborate with global teams in a fully remote setup.

What We’re Looking For :

  • Excellent English comprehension and writing skills.
  • Strong analytical and creative problem-solving ability.
  • Detail-oriented with good research and feedback skills.
  • No AI experience required
  • Bachelor’s in Engineering, Literature, Journalism, Arts, Statistics—or relevant experience.
  • Bonus : multilingual (Spanish / Portuguese), professional writing / editing experience, or proficiency with Excel / Google Suite.
  • Why Join Us :

  • Competitive pay and flexible remote work.
  • Learn how advanced AI systems are trained.
  • Be part of cutting-edge projects with top LLM companies.
  • Potential for contract extension.
  • Freelance perks : flexibility, global collaboration, and future-proof skills.
  • Offer Details :

  • Commitments Required : 40 hours per week with 4 hours of overlap with PST.
  • Engagement type : Contractor assignment / freelancer (no medical / paid leave)
  • Duration : 1 month.
  • Application Process :

  • Shortlisted candidates will be sent an automated challenge (60 mins).
  • Once you clear the challenge, we will reach out to you for an interview.
  • Once you clear the interview, you are ready to go!
  • About Turing :

    Turing, based in San Francisco, is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises. We advance cutting-edge research with high-quality data, training pipelines, and top AI talent across coding, reasoning, STEM, multilinguality, multimodality, and agents. We also help enterprises turn AI from proof-of-concept into proprietary systems that deliver reliable performance, measurable impact, and real results on the P&L.

    Know amazing talent? Refer them at turing.Com / referrals , and earn money from your network.

    Create a job alert for this search

    Analyst • Kolkata, Republic Of India, IN

    Related jobs
    • Promoted
    Appian QA Analyst

    Appian QA Analyst

    nineDots.ioKolkata, IN
    QA Analyst (Appian, Banking) – Contract.Immediate Start | Remote | GCC Hours.You’ll be responsible for designing, executing, and maintaining test cycles for Appian-based workflows, ensuring quality...Show moreLast updated: 3 days ago
    • Promoted
    Computer Vision & Multimodal LLM Intern (Engineering Drawing Analysis Agent)

    Computer Vision & Multimodal LLM Intern (Engineering Drawing Analysis Agent)

    doAZKolkata, IN
    Computer Vision & Multimodal LLM.Drawing Change Analysis Agent)About Doaz.Doaz turns fragmented industrial knowledge into instant, actionable insight. We build LLM- and Vision-AI solutions for const...Show moreLast updated: 3 days ago
    • Promoted
    MLOps Engineer

    MLOps Engineer

    Capgeminikolkata, west bengal, in
    Experience in developing MLOps framework cutting ML lifecycle : model development, training, evaluation, deployment, monitoring including Model Governance. Expert in Azure Databricks, Azure ML, Unity...Show moreLast updated: 1 day ago
    • Promoted
    Analyst

    Analyst

    Innodata Inc.kolkata, west bengal, in
    Innodata is collaborating with a leading international conglomerate, to contract subject matter experts (SMEs) for a complex prompt data annotation project. SMEs will create complex prompts and resp...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Digital Analyst

    Digital Analyst

    EXLKolkata, IN
    Digital Analytics Implementation Specialist.Adobe Experience Platform (AEP).The ideal candidate will be responsible for implementing and managing advanced analytics tracking frameworks, ensuring se...Show moreLast updated: 7 hours ago
    • Promoted
    Research Analyst - 45426

    Research Analyst - 45426

    TuringKolkata, IN
    Join us as an Research Analyst and help shape the future of large language models (like GPT).You’ll work on fascinating analytical questions, research real-world scenarios, and create structured co...Show moreLast updated: 30+ days ago
    • Promoted
    Data Analyst

    Data Analyst

    Unotech GlobalKolkata, IN
    Unotech Global is dedicated to solving real-world problems through innovative AI-driven solutions.Our company specializes in Artificial Intelligence applications across various fields, including Io...Show moreLast updated: 25 days ago
    AI Agent Evaluation Analyst

    AI Agent Evaluation Analyst

    MindriftKolkata, WB, IN
    Remote
    Quick Apply
    This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of En...Show moreLast updated: 26 days ago
    • Promoted
    ML Ops

    ML Ops

    EXLKolkata, IN
    Deploy, monitor, and scale ML models on.GCP (Vertex AI, GKE, Cloud Functions).GitHub Actions / Jenkins / cloud-native tools. Containerize and orchestrate workloads with.MLflow, Feast, Prometheus / Gra...Show moreLast updated: 30+ days ago
    • Promoted
    Data Integration Developer (Level 2)

    Data Integration Developer (Level 2)

    BluticKolkata, IN
    Data Integration Developer (Level 2).ETL processes, reports, and database solutions using.This role requires solid technical skills to implement solutions, optimize code, and collaborate effectivel...Show moreLast updated: 3 days ago
    • Promoted
    Tactical Analyst

    Tactical Analyst

    MAX SecurityKolkata, IN
    Max is Global Risk Management organization based out in Tel Aviv, Israel and its APAC HQ is based out of Mumbai.Led by veterans from Israeli Military Special Forces, Intelligence, Cyber and Secret ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior MLOps Engineer

    Senior MLOps Engineer

    Mitchell Martin Inc.Kolkata, IN
    Include, but are not limited to, the following : .Own productionizing models—from tracked experiments to governed releases—ensuring resilient services with clear SLOs, runbooks, and fast, safe rollba...Show moreLast updated: 30+ days ago
    • Promoted
    DS with Python : LLM Model training

    DS with Python : LLM Model training

    DeepLLMDataKolkata, IN
    DeepLLMData focuses on coding SFT, RLHF, STEM, PhD, Maths, Image and Video data annotators and provisioning.This is a Part-time remote role for LLM Model training. The task needs LLM Trainers to cre...Show moreLast updated: 1 day ago
    • Promoted
    Evaluation Specialist

    Evaluation Specialist

    LawSikhoKolkata, IN
    Job Description : Evaluation Associate LawSikho.We are hiring lawyers with excellent communication skills & analytical minds for our evaluations team. You have been working in contracts, compliance o...Show moreLast updated: 3 days ago
    • Promoted
    Content Analyst - 33800

    Content Analyst - 33800

    TuringKolkata, IN
    Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways : Working with the world’s leading AI...Show moreLast updated: 24 days ago
    • Promoted
    LLM Engineer

    LLM Engineer

    Insight GlobalKolkata, IN
    Insight Global is sourcing for an AI / LLM Engineer to sit remotely in India, joining a global consulting firm.This position will support various Digital Products Teams in the AI Center of Excellence...Show moreLast updated: 3 days ago
    • Promoted
    Data Analyst

    Data Analyst

    DraconXKolkata, IN
    AI business automation and AI-driven SaaS platforms.Specializing in MVP development, custom software, and automation systems, we help startups and enterprises accelerate growth and innovation.Our e...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Polarion ALM Expert – Process Implementation & Support

    Polarion ALM Expert – Process Implementation & Support

    Hexad Infosoft INkolkata, west bengal, in
    Polarion ALM Expert – Process Implementation & Support.R&D process digitalization project.The role involves implementing, configuring, and optimizing. The expert will collaborate with global stakeho...Show moreLast updated: 2 hours ago