Talent.com
LLM Evaluation Engineer
LLM Evaluation EngineerTuring • Ahmedabad, Republic Of India, IN
No longer accepting applications
LLM Evaluation Engineer

LLM Evaluation Engineer

Turing • Ahmedabad, Republic Of India, IN
11 days ago
Job description

Role Overview :

We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and code.

In this role, you’ll generate and evaluate high-quality data used to fine-tune and benchmark LLMs. You’ll design prompts, analyze model outputs, write Python solutions, and provide detailed feedback that guides model improvements. This is a unique opportunity to contribute to the next generation of AI systems—without needing to train or build the models yourself.

You’ll :

  • Write and maintain clean, efficient Python code for AI training and evaluation.
  • Evaluate and compare model responses as part of RLHF (Reinforcement Learning with Human Feedback).
  • Create and refine datasets for SFT (Supervised Fine-Tuning).
  • Develop reasoning-based feedback to enhance model accuracy and alignment.
  • Collaborate with cross-functional teams to ensure high-quality data and evaluations.

Requirements :

  • 3+ years of strong Python development experience.
  • Solid understanding of testing, debugging, async programming, and software best practices.
  • Excellent written and verbal communication in English.
  • Offer Details :

  • Commitment : Minimum 20 hrs / week (options for 20, 30, or 40 hrs).
  • Time Zone : 4-hour overlap with PST.
  • Contract : 1-month contractor role (no paid leave).
  • Evaluation : 2 interview rounds (~75 mins total).
  • Start : Expected next week.
  • Perks :

  • 100% remote work.
  • Collaborate with leading LLM and AI research teams.
  • Work on real-world AI challenges shaping the future of intelligent systems.
  • About Turing :

  • Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems.
  • Turing helps customers in two ways : Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge;
  • and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.

    Know amazing talent? Refer them at turing.Com / referrals, and earn money from your network.

    Create a job alert for this search

    Engineer Llm • Ahmedabad, Republic Of India, IN

    Related jobs
    Senior RTL Design Engineer

    Senior RTL Design Engineer

    MosChip® • Ahmedabad, IN
    Experience in Logic design / RTL coding is a must.Experience is SoC design and integration for complex SoCs is a must.Experience in Verilog / System-Verilog is a must. Experience in Multi Clock design...Show more
    Last updated: 5 days ago • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Innodata Inc. • Ahmedabad, IN
    Our AI-driven platforms and expert teams empower clients in healthcare, life insurance, and other industries to identify risks, improve efficiency, and make smarter decisions.By combining proprieta...Show more
    Last updated: 19 days ago • Promoted
    AIML Engineer

    AIML Engineer

    Tata Consultancy Services • ahmedabad, gujarat, in
    Competencies (Technical / Behavioral Competency).AI / ML, Azure ML Studio, AI / ML On Databricks, Python & CICD Devops.Supervised and unsupervised ML and Predictive Analytics using Python • Feature gener...Show more
    Last updated: 20 days ago • Promoted
    AI Engineer

    AI Engineer

    TechKareer • Gandhinagar, IN
    Mumbai / Bengaluru / Gurgaon (Hybrid : 3 days / week in office).Remote option for exceptional candidates.We’re building production-grade AI workflows and agentic applications that power real user expe...Show more
    Last updated: 30+ days ago • Promoted
    LLM Trainer

    LLM Trainer

    Insight Global • Anand, IN
    Insight Global Client is developing a computer usage dataset to train intelligent systems that understand how users interact with software applications. LLM Trainer (Computer Usage Data Collection)....Show more
    Last updated: 4 days ago • Promoted
    LLM Scientist

    LLM Scientist

    Insight Global • Ahmedabad, IN
    Familiarity with LangSmith, LangFuse, or similar LLM monitoring tools.Show more
    Last updated: 7 days ago • Promoted
    Lead Engineer

    Lead Engineer

    Hyqoo • Gandhinagar, IN
    Design, deploy, and manage AWS cloud infrastructure, including EC2 instances, S3 buckets, VPCs, RDS databases, and Lambda functions. Assist in the design, implementation, and maintenance of backup, ...Show more
    Last updated: 15 days ago • Promoted
    ML Ops

    ML Ops

    EXL • Gandhinagar, IN
    Deploy, monitor, and scale ML models on.GCP (Vertex AI, GKE, Cloud Functions).GitHub Actions / Jenkins / cloud-native tools. Containerize and orchestrate workloads with.MLflow, Feast, Prometheus / Gra...Show more
    Last updated: 30+ days ago • Promoted
    Senior ML Engineer

    Senior ML Engineer

    Piramal Finance • gandhinagar, gujarat, in
    Build and operate end-to-end ML / AI pipelines (data → training → deployment → monitoring).Automate CI / CD for ML / AI with Jenkins, integrate MLflow for tracking and registry.Deploy scalable batch and ...Show more
    Last updated: 19 days ago • Promoted
    LLM Trainer

    LLM Trainer

    Avance Consulting • Gandhinagar, IN
    Duration of contract : 1 month.Full Time Availability (8 Hrs) and 4 hours overlap with PST time zone.Any programming skills(Python OR JavaScript OR Java OR C++ OR C#). We are developing a computer u...Show more
    Last updated: 16 hours ago • Promoted • New!
    Founding MLOps Engineer

    Founding MLOps Engineer

    Vectorial AI • Ahmedabad, IN
    Vectorial is a simulation engine platform powered by millions of synthetic users—state-of-the-art models that capture real human behavior—to deliver instant, nuanced validation across the entire pr...Show more
    Last updated: 14 days ago • Promoted
    GTM Engineer

    GTM Engineer

    Scalantec • Gandhinagar, IN
    GTM Engineer (m / f / d) – Full Time, Remote.We’re looking for a GTM Engineer to help us build, automate and scale the outbound and growth systems behind our clients’ sales pipelines.You’ll work at the...Show more
    Last updated: 6 days ago • Promoted
    Senior MLOps Engineer (Production)

    Senior MLOps Engineer (Production)

    SAIVA AI • Anand, IN
    We are seeking a Senior Machine Learning Engineer to join our team and help shape the future of healthcare technology.In this role, you will design, build, and deploy machine learning systems that ...Show more
    Last updated: 30+ days ago • Promoted
    Search Engineer

    Search Engineer

    YourTribe • Gandhinagar, IN
    Design & implement search solutions.Architect and develop advanced search features using.OpenSearch / Elasticsearch, including custom analysers, tokenisers, and scoring algorithms.Create and maintain...Show more
    Last updated: 30+ days ago • Promoted
    Emulation Engineer / Lead

    Emulation Engineer / Lead

    eInfochips (An Arrow Company) • Anand, IN
    Role : Emulation Engineer / Lead.Job Location : Noida, Chennai, Bangalore, Hyderabad, Ahmedabad.You must be having BS or MS in Electrical OR Electronics engineering. Minimum 4+ Years of Emulation Expe...Show more
    Last updated: 30+ days ago • Promoted
    MLOps Engineer

    MLOps Engineer

    Capgemini • ahmedabad, gujarat, in
    Experience in developing MLOps framework cutting ML lifecycle : model development, training, evaluation, deployment, monitoring including Model Governance. Expert in Azure Databricks, Azure ML, Unity...Show more
    Last updated: 18 days ago • Promoted
    Responsible AI

    Responsible AI

    EXL • Gandhinagar, IN
    We are seeking a highly skilled and principled Responsible AI Evaluator to assess, audit, and ensure the ethical development and deployment of AI models across the enterprise.This role spans tradit...Show more
    Last updated: 30+ days ago • Promoted
    Senior ML Engineer

    Senior ML Engineer

    Torinit • Ahmedabad, IN
    Canadian-based digital consulting company.At Torinit, we don't just serve our clients; we work with them to create transformative digital journeys by leveraging the latest technologies and world-cl...Show more
    Last updated: 3 days ago • Promoted