Evaluation Scenario Writer - QA
MindriftKolkata, WB, IN- Remote
- Quick Apply
At Mindrift , innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI.
The Mindrift platform, launched and powered by Toloka , connects domain experts with cutting-edge AI projects from innovative tech clients. Our mission is to unlock the potential of GenAI by tapping into real-world expertise from across the globe.
Who we're looking for :
We’re looking for curious and intellectually proactive contributors who never miss an error and can think outside of the box when brainstorming solutions.
Are you comfortable with ambiguity and complexity? Does an async, remote, flexible opportunity sound exciting? Would you like to learn how modern AI systems are tested and evaluated?
This is a flexible, project-based opportunity well-suited for :
- Analysts, researchers, or consultants with strong critical thinking skills.
- Students (senior undergrads / grad students) looking for an intellectually interesting gig.
- People open to a part-time and non-permanent opportunity.
About the project :
We’re on the hunt for an Evaluation Scenario Writer - QA for a new project focused on ensuring the quality and correctness of evaluation scenarios created for LLM agents. This project opportunity blends manual scenario validation, automated test thinking, and collaboration with writers and engineers. You will verify test logic, flag inconsistencies, and help maintain a high bar for evaluation coverage and clarity.
What you’ll be doing :
Although we’re only looking for experts for this current project, contributors with consistent high-quality submissions may receive an invitation for ongoing collaboration across future projects.
How to get started
Apply to this post, qualify, and get the chance to contribute to a project aligned with your skills, on your own schedule. Shape the future of AI while building tools that benefit everyone.
Requirements
The ideal contributor will have :
We also value applicants who have :
Benefits
Contribute on your own schedule, from anywhere in the world. This opportunity allows you to :
Create a job alert for this search
Qa • Kolkata, WB, IN
- Promoted
- New!
Content Writer
SCOPEKolkata, IN- Promoted
Technical Content Writer – Cybersecurity & AI (ThreatLens)
ThreatLensKolkata, IN- Promoted
Content Writer
Spinta DigitalKolkata, IN- Promoted
- New!
Senior Content Writer
Fincart Financial PlannersKolkata, IN- Promoted
Prompt Engineer
Innodata Inc.Kolkata, IN- Promoted
AI & Business Technology Writer
CanadianSME Small Business MagazineKolkata, IN- Promoted
Language Model Evaluation Analyst
TuringKolkata, Republic Of India, IN- Promoted
Responsible AI
EXLKolkata, IN- Promoted
){kind=logo}
Articulate Content Writer
Sustainable Living Lab (SL2)Kolkata, INEvaluation Scenario Writer - AI Agent Testing Specialist
MindriftKolkata, WB, IN- Promoted
Content Writer
CIOMINDSKolkata, IN- Promoted
- New!
Content Specialist
Prosperr.ioKolkata, IN- Promoted
- New!
Content Writer - Cybersecurity
UnosecurKolkata, IN- Promoted
- New!
Senior Content Writer
Novelty WealthKolkata, IN- Promoted
Content Writer - 45427
TuringKolkata, IN- Promoted
Evaluation Specialist
LawSikhoKolkata, IN- Promoted
Technical Writer
AceolutionKolkata, IN- Promoted
- New!
