Talent.com
No longer accepting applications
QA / Red Teaming Expert

QA / Red Teaming Expert

Innodata Inc.Jaipur, IN
30+ days ago
Job description

Job Description :

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI / LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title : - Red Teaming, Prompt Evaluation, or AI / LLM Quality Assurance Expert

Key Responsibilities :

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements :

  • Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance , content review, or test case development for AI / ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
  • Preferred Qualifications :

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.
  • Background in linguistics, psychology, or computational ethics is a plus.

    Kindly Attempt the below assessment to proceed further with your application.

  • https : / / icap.innodata.com / registerfreelancer?enc=oUTZVsr / Pnz / 0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel
  • Create a job alert for this search

    Expert • Jaipur, IN

    Related jobs
    • Promoted
    AI-First QA Engineer (with Business Analysis Expertise)

    AI-First QA Engineer (with Business Analysis Expertise)

    CESJaipur, IN
    The role focuses on building quality from the first requirement using.You’ll work closely with product and development teams, using an AI-first approach to make testing faster, sharper, and more ef...Show moreLast updated: 16 days ago
    • Promoted
    Technical Implementation Engineer

    Technical Implementation Engineer

    Y MeadowsJaipur, IN
    Technical Implementation Engineer.Y Meadows is a United States-based company specializing in artificial intelligence and automation solutions. We provide a low-code automation platform that streamli...Show moreLast updated: 16 days ago
    • Promoted
    Specialist - Privacy Implementation

    Specialist - Privacy Implementation

    Baldor Technologies Private Limited (IDfy)Jaipur, IN
    IDfy is Asia’s leading TrustStack, trusted by the best, with global expertise and enterprise-grade tech, we’re solving trust challenges, making compliance easy,fraud detection smarter, and onboardi...Show moreLast updated: 18 days ago
    • Promoted
    Delivery Lead

    Delivery Lead

    RapidBrainsJaipur, IN
    Job Title : Portfolio Lead (Digital Delivery & Strategic Client Transformation).Remote / Hybird / Onsite as permanent employee. Company : Our Premium Client - German Based.We're seeking an experienced an...Show moreLast updated: 16 days ago
    • Promoted
    Senior Consultant / Architect – CyberArk (PAM)

    Senior Consultant / Architect – CyberArk (PAM)

    CyberSolveJaipur, IN
    CyberSolve is a fastest growing IAM Specialist firm in the US with aspirations of becoming the world's largest company in the IAM space. CyberSolve’s 350+ specialists solve interesting puzzles in IG...Show moreLast updated: 17 days ago
    • Promoted
    Retoucher / QA & Project Coordinator

    Retoucher / QA & Project Coordinator

    MS2Jaipur, IN
    MS2Creative is looking for a detail-oriented Retoucher who can also oversee quality assurance and manage project workflows. This is a dual-role position ideal for someone with strong image editing s...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Consultant (AI & Integrations)

    Technical Consultant (AI & Integrations)

    89 SolutionsJaipur, IN
    About Moveworks & 89 Solutions.Enterprise Agentic AI platform.IT, HR, Finance, Marketing etc).It offers an AI assistant that integrates with all applications in a company and helps employees to fin...Show moreLast updated: 26 days ago
    • Promoted
    Integration Developer

    Integration Developer

    Vriba SolutionsJaipur, IN
    PM IST to 3 : 30 AM IST (US Shift).Immediate joiners preferred (15–30 days max).We are looking for an experienced.Integration Developer (5–10 years). The role requires working closely with cross-funct...Show moreLast updated: 30+ days ago
    • Promoted
    Healthcare Integration Specalist

    Healthcare Integration Specalist

    Lenia HealthJaipur, IN
    We’re a fast-growing healthcare data services company focused on secure, intelligent data exchange.By simplifying interoperability and automating workflows, we help healthcare organisations connect...Show moreLast updated: 10 days ago
    • Promoted
    Senior Technical Consultant (AI & Integrations)

    Senior Technical Consultant (AI & Integrations)

    89 SolutionsJaipur, IN
    About Moveworks & 89 Solutions.Enterprise Agentic AI platform.IT, HR, Finance, Marketing etc).It offers an AI assistant that integrates with all applications in a company and helps employees to fin...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Specialist

    Technical Specialist

    HCLTechJaipur, IN
    Notice Period : Immediate Joiner is Preffered.Remote (may be Hybrid later, demand basis – client locatio.Bengaluru and ok for PAN India if the talent is good with right match.HTML5, CSS3 (Sass), an...Show moreLast updated: 30+ days ago
    • Promoted
    Design Quality Expert / Visual Merchandiser – Online Retail

    Design Quality Expert / Visual Merchandiser – Online Retail

    Virtual Ops, LLPjaipur, rajasthan, in
    Design Quality Expert / Visual Merchandiser.If you live and breathe product aesthetics, love perfecting visuals, and understand what drives shoppers to “Add to Cart,” this role is for you.D visuals...Show moreLast updated: 5 days ago
    • Promoted
    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Backgammon GalaxyJaipur, IN
    Backgammon Galaxy (backgammongalaxy.Remote (HQ in Cyprus) | Full-time.Backgammon Galaxy is the leading web and mobile platform for playing backgammon, with a community of 150,000+ players worldwide...Show moreLast updated: 30+ days ago
    • Promoted
    Webex CC

    Webex CC

    Servion Global SolutionsJaipur, IN
    As a Senior Applications Developer, this position partners with customers to design and implement Cisco contact center applications and IVR call flows. Rather than focusing on infrastructure, this r...Show moreLast updated: 18 days ago
    • Promoted
    Senior Technical Consultant

    Senior Technical Consultant

    R SystemsJaipur, IN
    Our product mindset and advanced engineering capabilities in.Customer Experience empower us to deliver innovative solutions to key players across the high-tech industry. This includes ISVs, SaaS, an...Show moreLast updated: 15 days ago
    • Promoted
    AppScan Product _Sr. QA Engineer (4-8 Yrs)

    AppScan Product _Sr. QA Engineer (4-8 Yrs)

    HCL AppScanJaipur, IN
    Is a Product Development Division of HCL Tech : That operates its primary Software business.At HCL Software we Develop, Market, Sell and Support over 20 Product families in the areas of Customer Exp...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Architect Team Lead

    Technical Architect Team Lead

    QNOPY Inc.jaipur, rajasthan, in
    We are seeking an experienced Technical Team Lead with a strong background in delivering SaaS products to lead our engineering team. The ideal candidate has 7+ years of hands-on experience in softwa...Show moreLast updated: 5 days ago
    • Promoted
    AppScan Product _Lead SDET_Remote Location

    AppScan Product _Lead SDET_Remote Location

    HCLSoftwareJaipur, IN
    Remote
    HCL Software” : - Is a Product Development Division of HCL Tech : That operates its primary Software business.At HCL Software we Develop, Market, Sell and Support over 20 Product families in the area...Show moreLast updated: 26 days ago