Please submit your CV in English and indicate your level of English proficiency.
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.
We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.
You'll create challenging tasks and evaluation criteria within realistic simulated environments:
What this is NOT:
What we look for:
Why this is hard:
Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.
Requirements and benefits
Educational qualifications
Academic and/or Professional Experience
Candidates should have a minimum of 3 years of professional experience in related roles or domain - specifically for QA-automation/testing or cybersecurity roles
How it works
Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid
Compensation:
Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks — up to the equivalent of $30/hr. Because payment is per task, a faster pace raises your effective hourly rate.
Why this freelance opportunity might be a great fit for you?
Freelance Agent Evaluation Engineer • Mumbai, MH, IN
Headquartered in San Francisco, our investors include.Product launch / experiment readiness Evaluator.Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide deck... Show more
Headquartered in San Francisco, our investors include.Customer success / support operations Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesth... Show more
Headquartered in San Francisco, our investors include.User/customer research and feedback synthesis Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factua... Show more
Headquartered in San Francisco, our investors include.Software / AI / IT / data Evaluator.Identify factual, aesthetic, and presentation errors in.Provide clear, structured written feedback to impro... Show more
Headquartered in San Francisco, our investors include.OS Engineer (Coding Agent Experience).Review model-generated mobile application code for correctness, quality, maintainability, and performance... Show more
Headquartered in San Francisco, our investors include.Legal contracts / diligence / redlines Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aest... Show more
Headquartered in San Francisco, our investors include.Clinical / biomedical / pharma Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesthetic, a... Show more
Headquartered in San Francisco, our investors include.ML Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, performance issues, and failu... Show more
Headquartered in San Francisco, our investors include.General business strategy / management Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aest... Show more
Headquartered in San Francisco, our investors include.Systems Engineer (Coding Agent Experience).Review model-generated code, architecture decisions, and systems implementations.Identify bugs, edge... Show more
Headquartered in San Francisco, our investors include.Market research / competitive intelligence Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, ... Show more
Headquartered in San Francisco, our investors include.Generalist - English & Urdu.Conduct fact-checking using trusted public sources and external.Generate high-quality human evaluation data by ... Show more
Headquartered in San Francisco, our investors include.People ops / recruiting Evaluator.Identify factual, aesthetic, and presentation errors in.Provide clear, structured written feedback to improve... Show more
Headquartered in San Francisco, our investors include.Procurement / vendor management Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesthetic, ... Show more
Headquartered in San Francisco, our investors include.Healthcare operations Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesthetic, and presen... Show more
Headquartered in San Francisco, our investors include.Spreadsheet QA / workbook maintenance Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesth... Show more
Headquartered in San Francisco, our investors include.Biology / environmental science Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesthetic, ... Show more
Headquartered in San Francisco, our investors include.Data analysis / quantitative readouts Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesth... Show more
Headquartered in San Francisco, our investors include.Cybersecurity / IT GRC Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesthetic, and prese... Show more
Headquartered in San Francisco, our investors include.Brand / creative direction / marketing collateral Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify fa... Show more
