Remote Senior Software Engineer (LLM) - 35501

Project Overview

We are developing high-quality training and evaluation datasets to improve how Large Language Models (LLMs) perform on real software engineering problems. The core of this project involves identifying and curating verifiable coding tasks from public GitHub repositories, supported by a human-in-the-loop review process.

As a contractor on this project, you will review code written by AI to solve real software tasks. Your feedback will help improve how future AI models learn to write and understand code.

Key Responsibilities

• Review and compare 3–4 model-generated code responses for each task using a structured ranking framework
• Assess code changes (diffs) for correctness, quality, readability, and performance
• Provide clear, concise explanations for your ranking decisions
• Maintain consistency and fairness across all evaluations
• Identify and document edge cases or unusual model behavior
• Collaborate with the team to improve evaluation processes and identify improvement areas

Required Qualifications

Professional Experience

Note : Experience from contractual or part-time roles will not be considered. Only full-time employment qualifies.

Technical Skills

Preferred Qualifications

Engagement Details

About Turing :

Turing is one of the world's fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. You'll be working at the intersection of software engineering, open-source ecosystems, and frontier AI.

If you have strong software engineering expertise and are interested in helping shape the next generation of AI-assisted development tools, we encourage you to apply

Show more

Show less

Skills Required

Version Control Systems, Debugging, Software Design