Talent.com
Turing
SwarmBench Task Engineer (Knowledge/Research) - 75064Turing • Meerut, IN
SwarmBench Task Engineer (Knowledge/Research) - 75064

SwarmBench Task Engineer (Knowledge/Research) - 75064

Turing • Meerut, IN
3 days ago
Job description

About Turing:

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.


Role Overview:

We are seeking a highly analytical and computationally proficient individual to join our team with a strong research background. You will be instrumental in contributing to this role by either crafting challenging and insightful problems in your respective research domain, devising elegant computational solutions.


Responsibilities:

  • Build multi-agent benchmark tasks that require reading, analyzing, and synthesizing large document collections
  • Curate real-world research corpora — academic papers, case studies, technical reports — and design questions that require comprehensive analysis
  • Write structured ground-truth oracles (JSON) with specific, verifiable answers that prove the agent actually read the source material
  • Design LLM judge prompts that evaluate agent output field-by-field against the oracle
  • Create decomposition guides that split research across multiple parallel sub-agents (one per document, one per domain, then synthesis)


Required Qualifications:

  • 5+ years of research experience (academic or industry) in any scientific domain
  • Strong reading comprehension with ability to extract structured data from unstructured text
  • Experience with JSON and data structures, including schema design and output validation
  • Proficiency in Python scripting for data processing and evaluation (e.g., judge scripts)
  • Familiarity with AI coding benchmarks such as SWE-bench and Terminal-bench
  • Hands-on experience with Docker (writing Dockerfiles, building images, debugging containers)
  • High attention to detail, especially for creating precise evaluation oracles without approximations


Nice to have:

  • Experience with systematic reviews, meta-analyses, or large-scale literature surveys
  • Familiarity with medical, legal, or scientific document analysis
  • Experience with NLP or information extraction tasks
  • Knowledge of LLM evaluation and benchmarking (e.g., MMLU, GPQA, SimpleQA)
  • Experience curating datasets for AI evaluation


Perks of Freelancing With Turing:

  • Work in a fully remote environment.
  • Opportunity to work on cutting-edge AI projects with leading LLM companies.
  • Potential for contract extension based on performance and project needs.


Offer Details:

  • Commitments Required : 40 hours /week with 4 hours of PST Overlap
  • Engagement type : Contractor assignment/freelancer (no medical/paid leave)
  • Duration of contract : 1 month; [expected start date is next week]
Create a job alert for this search

SwarmBench Task Engineer (Knowledge/Research) - 75064 • Meerut, IN

Similar jobs

Senior MLOps Engineer (GCP / CV / Perception Pipelines)

Jaipur Roboticsmeerut, uttar pradesh, in

At Jaipur Robotics, we build AI systems that turn visual and sensor data into automation, efficiency, and operational intelligence for the waste industry.We are a fast-growing, VC-backed clean-tech... Show more

 • Promoted

GenAI Engineer Intern

Cerebrone.aimeerut, uttar pradesh, in

Job Title: Generative AI Engineer Intern.Duration: 6 Months (extendable).We go beyond courses and , interns and members build real GenAI systems—AI agents, RAG pipelines, memory layers, evaluation ... Show more

 • Promoted

AI Inference Engineer QVAC (100% remote Worldwide)

Tether.iomeerut, uttar pradesh, in
Remote

Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.Our cutting-edge solutions empower businesses—from ex... Show more

 • Promoted

Estimation Engineer (LV / BMS)

Jobstronautmeerut, uttar pradesh, in

This is a remote role for a client based in Saudi Arabia.The client is looking to hire a.Bachelor’s in Electrical / Mechanical / Instrumentation Engineering.Cost estimation, document formatting, pr... Show more

 • Promoted

SwarmBench Task Engineer (Knowledge/Research) - 75064

Turingmeerut, uttar pradesh, in

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.Turing support... Show more

 • Promoted

SwarmBench Task Engineer (Data Analysis) - 75113

Turingmeerut, uttar pradesh, in

Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems.Turing helps customers in two ways: working with the world’s leading AI... Show more

 • Promoted

Backend Engineer - Wallets (100% remote Worldwide)

Tether.iomeerut, uttar pradesh, in
Remote

Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.Our cutting-edge solutions empower businesses—from ex... Show more

 • Promoted

Generative AI Engineer

EXLmeerut, uttar pradesh, in

AI Engineer / Builder (1–5 Years Experience) — LLMs, Agents, RAG.If you love experimenting with AI, shipping real products, breaking things, and rebuilding them better, this role is for you.Rapid p... Show more

 • Promoted

Senior Back End Engineer

Elife Transfermeerut, uttar pradesh, in

Job Title: Senior Backend AI Engineer.Founded in 2019, Elife Transfer is a fast-growing startup headquartered in San Francisco, California, at the heart of Silicon Valley.We are an all-in-one globa... Show more

 • Promoted

Platform Engineer

Hyqoomeerut, uttar pradesh, in

Lead the deployment and onboarding of enterprise AI tools (e.Claude, Lovable, ChatGPT Enterprise, etc.Manage tool configuration, licensing, and user provisioning across AI and SaaS platforms.Partne... Show more

 • Promoted

Gen AI Machine Learning Engineer

Astekmeerut, uttar pradesh, in

AI and machine learning, out of which 3+ years of experience in machine learning engineering, NLP, Generative AI, and LLM technologies.Experience with LLM Agentic workflows and frameworks (Langchai... Show more

 • Promoted

Senior AI Backend Engineer

Epitria Consultingmeerut, uttar pradesh, in

We are seeking a highly skilled.You will work at the core of our AI infrastructure, integrating machine learning models, optimizing inference performance, and building reliable APIs and data pipeli... Show more

 • Promoted

Forward Deployed Engineer

Recromeerut, uttar pradesh, in

We are looking for a hands-on engineering leader who can own complex projects end-to-end, build high-quality products, and elevate team performance.This role blends strong coding ability, product t... Show more

 • Promoted

Generative AI Engineer

Urbane Systemsmeerut, uttar pradesh, in

You will be responsible for the hands-on development, coding, and deployment of AI-powered features.Your focus is on writing clean, efficient code to integrate LLMs into our existing tech stack, bu... Show more

 • Promoted

Cloud Platform Engineer - AWS | Databricks | Jenkins | Terraform | Python - 5+ Years - Immediate

Blue Cloud Softech Solutions Limitedmeerut, uttar pradesh, in

Job Title: Cloud Platform Engineer.Location: [Bangalore / US Shift hours (6.Function: AWS | Databricks | Jenkins | Terraform | Python.At BCSS, you will unleash your potential working with people fr... Show more

 • Promoted

Detection Engineer

Maandag® Middle Eastmeerut, uttar pradesh, in

We are looking for Detection Engineer with AI exposure.Company Head office: Dubai, UAE.Own the technical onboarding and telemetry readiness that powers the MDR service.Ensure every client environme... Show more

 • Promoted

Machine Learning Engineer

CareerUS Solutionsmeerut, uttar pradesh, in

Job Title: Machine Learning Engineer (Remote – India).We are seeking a highly motivated Machine Learning Engineer to design, build, and deploy scalable machine learning models that solve real-world... Show more

 • Promoted

BeyondTrust Engineer – SME/Level 3 Engineer

London Strategymeerut, uttar pradesh, in

We are looking for a experienced BeyondTrust SME / level 3 engineer to join our team and support the delivery of critical infrastructure and security programs.As a BeyondTrust Engineer, you will be... Show more