Talent.com
Language Model Evaluation Analyst

Language Model Evaluation Analyst

TuringPune, Republic Of India, IN
1 day ago
Job description

About the Role :

Join us as an Research Analyst and help shape the future of large language models (like GPT). You’ll work on fascinating analytical questions, research real-world scenarios, and create structured content that improves how AI understands and responds. No AI experience is required—just strong English skills, sharp reasoning, and curiosity.

What You’ll Do :

  • Read, analyze, and break down large content into smaller logical blocks.
  • Validate claims and conduct online research to ensure accuracy.
  • Create puzzles, scenarios, and tricky questions to train AI models.
  • Provide clear, structured feedback to fine-tune responses
  • Collaborate with global teams in a fully remote setup.

What We’re Looking For :

  • Excellent English comprehension and writing skills.
  • Strong analytical and creative problem-solving ability.
  • Detail-oriented with good research and feedback skills.
  • No AI experience required
  • Bachelor’s in Engineering, Literature, Journalism, Arts, Statistics—or relevant experience.
  • Bonus : multilingual (Spanish / Portuguese), professional writing / editing experience, or proficiency with Excel / Google Suite.
  • Why Join Us :

  • Competitive pay and flexible remote work.
  • Learn how advanced AI systems are trained.
  • Be part of cutting-edge projects with top LLM companies.
  • Potential for contract extension.
  • Freelance perks : flexibility, global collaboration, and future-proof skills.
  • Offer Details :

  • Commitments Required : 40 hours per week with 4 hours of overlap with PST.
  • Engagement type : Contractor assignment / freelancer (no medical / paid leave)
  • Duration : 1 month.
  • Application Process :

  • Shortlisted candidates will be sent an automated challenge (60 mins).
  • Once you clear the challenge, we will reach out to you for an interview.
  • Once you clear the interview, you are ready to go!
  • About Turing :

    Turing, based in San Francisco, is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises. We advance cutting-edge research with high-quality data, training pipelines, and top AI talent across coding, reasoning, STEM, multilinguality, multimodality, and agents. We also help enterprises turn AI from proof-of-concept into proprietary systems that deliver reliable performance, measurable impact, and real results on the P&L.

    Know amazing talent? Refer them at turing.Com / referrals , and earn money from your network.

    Create a job alert for this search

    Analyst • Pune, Republic Of India, IN

    Related jobs
    • Promoted
    AI Model Evaluation Specialist

    AI Model Evaluation Specialist

    TuringRepublic Of India, IN
    Remote contract for PhDs in Mathematics, Statistics, or related fields.Work on cutting-edge projects with top AI labs while. Help fine-tune large language models (like ChatGPT) using your math and a...Show moreLast updated: 30+ days ago
    • Promoted
    ML Ops

    ML Ops

    EXLNagpur, IN
    Deploy, monitor, and scale ML models on.GCP (Vertex AI, GKE, Cloud Functions).GitHub Actions / Jenkins / cloud-native tools. Containerize and orchestrate workloads with.MLflow, Feast, Prometheus / Gra...Show moreLast updated: 30+ days ago
    • Promoted
    Data Modeling and Integration Architect

    Data Modeling and Integration Architect

    CareerUS SolutionsRepublic Of India, IN
    The Data Architect is responsible for.This includes ensuring that data is.The role focuses on developing.Collaborate with software engineers, analysts, and stakeholders to understand data needs and...Show moreLast updated: 2 days ago
    • Promoted
    Analyst

    Analyst

    Innodata Inc.Nagpur, IN
    Innodata is collaborating with a leading international conglomerate, to contract subject matter experts (SMEs) for a complex prompt data annotation project. SMEs will create complex prompts and resp...Show moreLast updated: 4 days ago
    • Promoted
    AI Model Evaluation Engineer

    AI Model Evaluation Engineer

    TuringRepublic Of India, IN
    We’re looking for experienced Python developers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and...Show moreLast updated: 30+ days ago
    • Promoted
    LLM Evaluation and Annotation Specialist

    LLM Evaluation and Annotation Specialist

    Innodata Inc.Republic Of India, IN
    Innodata (NASDAQ : INOD) is a leading data engineering company.With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4...Show moreLast updated: 1 day ago
    • Promoted
    Python Language Model Integration Specialist

    Python Language Model Integration Specialist

    TuringRepublic Of India, IN
    We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and ...Show moreLast updated: 2 days ago
    • Promoted
    AI Model Evaluation Specialist

    AI Model Evaluation Specialist

    People Prime WorldwideRepublic Of India, IN
    Our client is a trusted global innovator of IT and business services.We help clients transform through consulting, industry solutions, business process services, digital & IT modernization and mana...Show moreLast updated: 1 day ago
    • Promoted
    Implementation Analyst

    Implementation Analyst

    ConfidentialIndia
    Implementation Analyst- Role Overview.The Implementations function has the responsibility for delivering customer focused solutions from requirements definition, through build and integration, test...Show moreLast updated: 8 days ago
    • Promoted
    AI Research Engineer (Model Evaluation)

    AI Research Engineer (Model Evaluation)

    ConfidentialIndia
    Join Tether and Shape the Future of Digital Finance.At Tether, we're not just building products, we're pioneering a global financial revolution. Our cutting-edge solutions empower businesses—from ex...Show moreLast updated: 8 days ago
    • Promoted
    Financial Language Model Analyst

    Financial Language Model Analyst

    TuringRepublic Of India, IN
    Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways : Working with the world’s leading AI...Show moreLast updated: 1 day ago
    • Promoted
    Statistical Modeling Analyst

    Statistical Modeling Analyst

    Innova ESIChennai, Republic Of India, IN
    SQL, Tableau or Power BI, Statistical Modeling - Data Analyst.BI Data Analyst / Specialist 3 (6-9 Years).Data Visualization using either Tableau or Power BI. You will be responsible for conducting con...Show moreLast updated: 1 day ago
    • Promoted
    Polarion ALM Expert – Process Implementation & Support

    Polarion ALM Expert – Process Implementation & Support

    Hexad Infosoft INNagpur, IN
    Polarion ALM Expert – Process Implementation & Support.R&D process digitalization project.The role involves implementing, configuring, and optimizing. The expert will collaborate with global stakeho...Show moreLast updated: 1 day ago
    • Promoted
    Statistical Modeling Analyst

    Statistical Modeling Analyst

    Sambodhi Research and Communications Pvt. Ltd.Republic Of India, IN
    Sambodhi Research & Communications Pvt.We offer project management, monitoring & evaluation, and research solutions to various stakeholders, including government bodies, aid agencies, and corporate...Show moreLast updated: 15 days ago
    • Promoted
    AI Model Evaluation and Training Engineer

    AI Model Evaluation and Training Engineer

    People Prime WorldwideRepublic Of India, IN
    Our client is a Palo Alto–based AI infrastructure and talent platform founded in 2018.It helps companies connect with remote software developers using AI-powered vetting and matching technology.Ori...Show moreLast updated: 1 day ago
    AI Agent Evaluation Analyst

    AI Agent Evaluation Analyst

    MindriftIN
    Remote
    Quick Apply
    This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of En...Show moreLast updated: 27 days ago
    • Promoted
    Model Validation Analyst Senior

    Model Validation Analyst Senior

    ConfidentialIndia
    Every career journey is personal.That's why we empower you with the tools and support to create your own success story.The Model Validation team is responsible for Model Risk Management for Bread F...Show moreLast updated: 8 days ago
    • Promoted
    Language Model Evaluation Analyst

    Language Model Evaluation Analyst

    TuringRepublic Of India, IN
    Join us as an Research Analyst and help shape the future of large language models (like GPT).You’ll work on fascinating analytical questions, research real-world scenarios, and create structured co...Show moreLast updated: 1 day ago