Talent.com
No longer accepting applications
AI Model Evaluation Engineer

AI Model Evaluation Engineer

TuringKolkata, Republic Of India, IN
30+ days ago
Job description

Role Overview :

We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and code.

In this role, you’ll generate and evaluate high-quality data used to fine-tune and benchmark LLMs. You’ll design prompts, analyze model outputs, write Python solutions, and provide detailed feedback that guides model improvements. This is a unique opportunity to contribute to the next generation of AI systems—without needing to train or build the models yourself.

You’ll :

  • Write and maintain clean, efficient Python code for AI training and evaluation.
  • Evaluate and compare model responses as part of RLHF (Reinforcement Learning with Human Feedback).
  • Create and refine datasets for SFT (Supervised Fine-Tuning).
  • Develop reasoning-based feedback to enhance model accuracy and alignment.
  • Collaborate with cross-functional teams to ensure high-quality data and evaluations.

Requirements :

  • 3+ years of strong Python development experience.
  • Solid understanding of testing, debugging, async programming, and software best practices.
  • Excellent written and verbal communication in English.
  • Offer Details :

  • Commitment : Minimum 20 hrs / week (options for 20, 30, or 40 hrs).
  • Time Zone : 4-hour overlap with PST.
  • Contract : 1-month contractor role (no paid leave).
  • Evaluation : 2 interview rounds (~75 mins total).
  • Start : Expected next week.
  • Perks :

  • 100% remote work.
  • Collaborate with leading LLM and AI research teams.
  • Work on real-world AI challenges shaping the future of intelligent systems.
  • About Turing :

    Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems.

  • Turing helps customers in two ways : Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge;
  • and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.

    Know amazing talent? Refer them at turing.Com / referrals, and earn money from your network.

    Create a job alert for this search

    Ai Engineer • Kolkata, Republic Of India, IN

    Related jobs
    • Promoted
    Remote GenAI Engineer

    Remote GenAI Engineer

    EazyMLKolkata, IN
    Remote
    Founded by Bell Labs research veterans, and associated with breakthrough startups like Amelia, EazyML, specializes in Transparent Machine Learning. Early on EazyML founders saw the need for Transpa...Show moreLast updated: 30+ days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Qubrid AIKolkata, IN
    Work from Home! Compensation 8-9 LPA.Plus Please do not apply if compensation is not acceptable.Qubrid AI is a leading provider of high-performance GPU cloud infrastructure and advanced AI software...Show moreLast updated: 2 days ago
    • Promoted
    AI / ML Engineer

    AI / ML Engineer

    TransPerfectkolkata, west bengal, in
    We are seeking a Senior AI / ML Engineer to join our client’s AI team and contribute to the development of cutting-edge intelligent systems. In this role, you’ll be responsible for designing, training...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    MightyBotKolkata, IN
    Join our team as an AI Engineer, where we're focused on graduating AI from interesting demos to indispensable products.You will build reliable, self-improving systems that empower subject matter ex...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    RecroKolkata, IN
    Job Description : AI / ML Engineer (3D Geometry & Manufacturing).We are seeking an exceptionally talented and entrepreneurial. Design for Manufacturability (DFM).If you are passionate about leveraging ...Show moreLast updated: 30+ days ago
    • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Edstem TechnologiesKolkata, IN
    The ideal candidate will have hands-on expertise across the full ML lifecycle—from data exploration and feature engineering to model training, optimization, and production deployment.You will work ...Show moreLast updated: 18 days ago
    • Promoted
    AI Engineer

    AI Engineer

    Aura Recruitment SolutionsKolkata, IN
    Pay starts from 150,000 INR per Month.We’re hiring on behalf of our client, a fast-growing, AI-first company building cutting-edge AI-native applications that transform complex, real-world data int...Show moreLast updated: 12 days ago
    • Promoted
    ML / Gen AI Engineer

    ML / Gen AI Engineer

    Intuition IT – Intuitive Technology RecruitmentKolkata, IN
    Design, deploy, and manage scalable ML and GenAI workloads using AWS services including SageMaker Studio and Bedrock.Implement and maintain infrastructure using AWS Lambda, EKS, ECS on Fargate, and...Show moreLast updated: 2 days ago
    • Promoted
    Machine Learning Engineer-Agentic AI

    Machine Learning Engineer-Agentic AI

    Innodata Inc.Kolkata, IN
    Design and implement multi-agent systems using LangChain, LangGraph, CrewAI, AutoGen or similar frameworks.Build A2A (agent-to-agent) orchestration and implement MCP (multi-context protocol) for co...Show moreLast updated: 18 days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Live ConnectionsKolkata, IN
    We’re Hiring | Generative AI Lead / Principal Engineer.Are you passionate about building cutting-edge.Generative AI and LLM solutions. We’re looking for an experienced.Generative AI Lead / Principal...Show moreLast updated: 10 days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Turingkolkata, west bengal, in
    Turing is looking for people with LLM experience to join us in solving business problems for our Fortune 500 customers.You will be a key member of the Turing GenAI delivery organization and part of...Show moreLast updated: 15 days ago
    • Promoted
    AI Developer - ML & AI Agents (3 to 9 Years)

    AI Developer - ML & AI Agents (3 to 9 Years)

    AIMLEAPKolkata, IN
    AI Developer - ML & AI Agents (3 to 9 Years).Tech in Computer Science, AI / ML, or related field.AI / ML with hands-on exposure to LLMs and agentic AI development. Strong Python programming background f...Show moreLast updated: 4 days ago
    • Promoted
    Responsible AI

    Responsible AI

    EXLKolkata, IN
    We are seeking a highly skilled and principled Responsible AI Evaluator to assess, audit, and ensure the ethical development and deployment of AI models across the enterprise.This role spans tradit...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    Tensor PilotKolkata, IN
    Tensor Pilot, through its flagship product Tensor AI, provides a sophisticated desktop-based AI assistant for interacting with local files such as code, documents, images, and videos.Tensor AI emph...Show moreLast updated: 1 day ago
    • Promoted
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Cloud 9 Solutions, LLCKolkata, IN
    Should have experience in building.Having knowledge in Microsoft Copilot studio is an advantage.Type : Fulltime (40 hours per week). AI / ML architecture, with at least 3 years focused on enterprise-le...Show moreLast updated: 30+ days ago
    • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Innodata Inc.Kolkata, IN
    Our AI-driven platforms and expert teams empower clients in healthcare, life insurance, and other industries to identify risks, improve efficiency, and make smarter decisions.By combining proprieta...Show moreLast updated: 17 days ago
    • Promoted
    AI Engineer

    AI Engineer

    AsiteKolkata, IN
    We start with a simple idea : the built environment should be smarter, safer and more sustainable.Everything we do is about helping the people behind major construction and infrastructure projects w...Show moreLast updated: 1 day ago
    • Promoted
    Lead Engineer - AI / ML

    Lead Engineer - AI / ML

    Mindfire SolutionsKolkata, IN
    As a Lead AI / ML Engineer, you spearhead the design, development, and implementation of advanced AI and machine learning models. Your role involves guiding a team of engineers ensuring the successful...Show moreLast updated: 30+ days ago