Talent.com
Principal Software Engineer - AI Model Evaluation

Principal Software Engineer - AI Model Evaluation

TuringRepublic Of India, IN
30+ days ago
Job description

Role Overview :

Turing is seeking experienced software engineers to help design and validate real-world coding tasks that push the limits of today’s large language models. You’ll work hands-on with public GitHub repositories — standing up environments, extending test coverage, triaging issues, and building reproducible evaluation tasks that challenge model reasoning and execution.

This is a fully remote, flexible opportunity — work from anywhere, on your own schedule — while earning up to $100 / hr.

What You’ll Do :

  • Identify and triage issues in high-quality open-source repositories.
  • Stand up development environments (including Docker) and run / modify projects locally.
  • Assess and extend unit-test coverage to ensure reliable, verifiable benchmarks.
  • Design software engineering tasks from real repository histories for AI training and evaluation.
  • Optionally lead junior engineers on validation and repo triage efforts.

What We’re Looking For :

  • Proficiency in at least one major language : Python, JavaScript, Java, Go, Rust, C / C++, C#, or Ruby.
  • Hands-on experience with Git, Docker, CI pipelines, and navigating complex codebases.
  • Comfort contributing to and evaluating open-source repositories.
  • Strong debugging, problem-solving, and software design instincts.
  • Bonus : prior experience with LLM evaluation, developer tools, or agents.
  • Excellent English communication skills for precise technical feedback.
  • Why You'll Love This Role :

  • Remote & Flexible → Work from anywhere, at your own pace.
  • Competitive Pay → Earn up to $100 / hr.
  • Challenging Work → Tackle complex OSS repos that stretch AI capabilities.
  • Growth Potential → Lead efforts and collaborate closely with top AI researchers.
  • Impact → Help define how next-gen AI models are benchmarked and trained.
  • About Turing :

  • Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways : first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents;
  • and second, by applyingthat expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.

    Create a job alert for this search

    Principal Software Engineer • Republic Of India, IN

    Related jobs
    • Promoted
    • New!
    Lead AI Engineer

    Lead AI Engineer

    BlendNagpur, IN
    We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show moreLast updated: 1 hour ago
    • Promoted
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent PartnerNagpur, IN
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show moreLast updated: 4 days ago
    • Promoted
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire SolutionsNagpur, IN
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 16 days ago
    • Promoted
    Machine Learning Engineer - Agentic AI & AIOps

    Machine Learning Engineer - Agentic AI & AIOps

    Platform9Nagpur, IN
    Platform9 is a leader in simplifying enterprise private clouds.Our flagship product, Private Cloud Director, turns existing infrastructure into a full-featured private cloud.Enterprise IT teams can...Show moreLast updated: 1 day ago
    • Promoted
    AI Engineer – Generative AI

    AI Engineer – Generative AI

    IntraEdgeNagpur, IN
    We are seeking a highly skilled.Generative AI, Agent Frameworks, and AWS Serverless technologies.The ideal candidate will have a strong foundation in Python-based AI development and hands-on experi...Show moreLast updated: 4 days ago
    • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Kresta Softech Private LimitedNagpur, IN
    Job Title : Senior AI / ML Engineer - Generative AI & LLMs.Industry : Healthcare / Automotive OEC.Location : Hyderabad (On-Site) / Remote. We're seeking an expert AI / ML Engineer to lead development of cut...Show moreLast updated: 4 days ago
    • Promoted
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Tata Consultancy ServicesNagpur, IN
    Job Title : Artificial Intelligence Engineer.Required Skillset : Senior Full Stack & AI Engineer (AWS | Node.Location : Delhi / Bangalore / Hyderabad / Pune / Mumbai. We are looking for an experienced.Seni...Show moreLast updated: 30+ days ago
    • Promoted
    Responsible AI

    Responsible AI

    EXLIndia, India
    We are seeking a highly skilled and principled Responsible AI Evaluator to assess, audit, and ensure the ethical development and deployment of AI models across the enterprise.This role spans tradit...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    TalentBridgeNagpur, IN
    Job Type : 6-Month Contract, after 6 months it will convert to fulltime.We are looking for an experienced AIML Engineer with 4–8 years of expertise in AI / ML solutions, specifically in building intel...Show moreLast updated: 23 days ago
    • Promoted
    AI / ML Engineer (3 to 5 Years)

    AI / ML Engineer (3 to 5 Years)

    DXFactorNagpur, IN
    DXFactor is looking for AI / ML Engineer (3 to 6 Yrs).DXFactor is a US-based tech company working with fortune 500 customers across the globe. Location : SG Highway, Ahmedabad (Work from Office).We are...Show moreLast updated: 4 days ago
    • Promoted
    Full Stack AI engineer

    Full Stack AI engineer

    AnswerThis (YC F25)Nagpur, IN
    Remote (Applications open worldwide).Semantic Search, Vector Databases, Prompt Engineering, GenAI Frameworks, React Agents, Graph Agents, Document Parsing, Python, Scalable APIs.AnswerThis is an AI...Show moreLast updated: 30+ days ago
    • Promoted
    Gen Ai - Engineer

    Gen Ai - Engineer

    Diligente TechnologiesNagpur, IN
    Hands-on experience with Generative AI (GenAI) and agent-based AI frameworks.Proficiency in backend programming languages such as Node. Strong knowledge of both SQL and NoSQL databases.Experience wi...Show moreLast updated: 23 days ago
    • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Innodata Inc.Nagpur, IN
    Our AI-driven platforms and expert teams empower clients in healthcare, life insurance, and other industries to identify risks, improve efficiency, and make smarter decisions.By combining proprieta...Show moreLast updated: 2 days ago
    • Promoted
    AI Exploration Engineer

    AI Exploration Engineer

    Mitchell Martin Inc.Nagpur, IN
    Design and execute machine learning experiments to evaluate emerging AI technologies and frameworks.Prototype and assess end-to-end AI solutions to inform product and platform strategy.Formulate hy...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Software Engineer AI / ML

    Principal Software Engineer AI / ML

    CotivitiIndia, India
    We are seeking a software architect designing comprehensive MLOps platform, establishing technical standards, and leading infrastructure integration for ML deployment. Principal Responsibilities and...Show moreLast updated: 1 day ago
    • Promoted
    Remote GenAI Engineer

    Remote GenAI Engineer

    EazyMLNagpur, IN
    Remote
    Founded by Bell Labs research veterans, and associated with breakthrough startups like Amelia, EazyML, specializes in Transparent Machine Learning. Early on EazyML founders saw the need for Transpa...Show moreLast updated: 18 days ago
    • Promoted
    AI Developer - Transformers - 3 to 6 Years

    AI Developer - Transformers - 3 to 6 Years

    AIMLEAPNagpur, IN
    AI Developer - Transformers (2 – 6 Years).Tech in Computer Science, AI / ML, or related field.AI / ML with hands-on exposure to LLMs and agentic AI development. Strong Python programming background for ...Show moreLast updated: 4 days ago
    • Promoted
    Machine Learning Engineer-Agentic AI

    Machine Learning Engineer-Agentic AI

    Innodata Inc.Nagpur, IN
    Design and implement multi-agent systems using LangChain, LangGraph, CrewAI, AutoGen or similar frameworks.Build A2A (agent-to-agent) orchestration and implement MCP (multi-context protocol) for co...Show moreLast updated: 3 days ago