Talent.com
This job offer is not available in your country.
QA / Red Teaming Expert

QA / Red Teaming Expert

Innodata Inc.Kalyan-Dombivli, IN
22 hours ago
Job description

Job Description :

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI / LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title : - Red Teaming, Prompt Evaluation, or AI / LLM Quality Assurance Expert

Key Responsibilities :

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements :

  • Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance , content review, or test case development for AI / ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
  • Preferred Qualifications :

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.
  • Background in linguistics, psychology, or computational ethics is a plus.

    Kindly Attempt the below assessment to proceed further with your application.

  • https : / / icap.innodata.com / registerfreelancer?enc=oUTZVsr / Pnz / 0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel
  • Create a job alert for this search

    Expert • Kalyan-Dombivli, IN

    Related jobs
    • Promoted
    Core.NET Technologies

    Core.NET Technologies

    Tata Consultancy ServicesMumbai, IN
    Required Technical Skill Set • •.Net Core, C#,Web API and Entity Framework , MS SQL ,.Desired Competencies (Technical / Behavioral Competency). Ideally should not be more than 3-5).Strong analytical and...Show moreLast updated: 21 days ago
    • Promoted
    Technical Lead

    Technical Lead

    Servion Global SolutionsThane, IN
    We’re Hiring : Genesys PureConnect Engineer!!.Strong background in troubleshooting, support, and maintenance of Genesys PureConnect environments. Bachelor’s degree or equivalent in Computer Science o...Show moreLast updated: 18 days ago
    • Promoted
    Design Specialist

    Design Specialist

    Cactus CommunicationsKalyan-Dombivli, IN
    Digital Media Solutions (DMS) works with scientists, universities, organizations, societies, and publishers across more than 150 accounts from around the world. At DMS, we work with different stakeh...Show moreLast updated: 27 days ago
    • Promoted
    Azure Integration Services

    Azure Integration Services

    VicTree SolutionsKalyan-Dombivli, IN
    Strong experience with Azure Integration Services (e.Logic Apps, Azure Functions, APIM, Service Bus, Event Grid).Experience in developing Azure Functions (serverless) for event-driven or API-based ...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    QA / Red Teaming Expert

    QA / Red Teaming Expert

    Innodata Inc.Mumbai, IN
    We are seeking highly analytical and detail-oriented professionals with hands-on experience in.Red Teaming, Prompt Evaluation. The ideal candidate will help us rigorously test and evaluate AI-genera...Show moreLast updated: 22 hours ago
    • Promoted
    • New!
    Security Consultant (Red Teamer)

    Security Consultant (Red Teamer)

    ChaleitMumbai, IN
    We're hiring a Specialist Red Teamer to join Chaleit Services.If you have 4–8 years of hands-on offensive security experience and love emulating real adversaries to harden defences, we want to talk...Show moreLast updated: 22 hours ago
    • Promoted
    Lead Generation Expert

    Lead Generation Expert

    Mariox SoftwareMumbai, Maharashtra, India
    We are looking for a motivated Lead Generation Specialist with 1+ year experience in international IT Leads Generation (App & Web Development) using platforms like LinkedIn Sales Navigator, A...Show moreLast updated: 30+ days ago
    • Promoted
    OpenLink Endur Findur QA (Consultant / Senior / Principal Consultant)

    OpenLink Endur Findur QA (Consultant / Senior / Principal Consultant)

    KWA AnalyticsKalyan-Dombivli, IN
    About KWA Analytics : We are a global organisation offering a comprehensive range of consulting services for trade lifecycle management to clients involved in energy, commodities, shipping, treasury...Show moreLast updated: 19 days ago
    • Promoted
    • New!
    AI Team Web Developer — React / Tailwind (SaaS)

    AI Team Web Developer — React / Tailwind (SaaS)

    Visual AIdThane, IN
    Visual AID is a startup pioneering AI-driven cosmetic surgery planning, focusing on developing a bias-free, inclusive Novel Human-Face Medical Model through rigorous research and medical testing.By...Show moreLast updated: 22 hours ago
    • Promoted
    Red Teaming - Gemini Model Specialist

    Red Teaming - Gemini Model Specialist

    TPdombivli, maharashtra, in
    Role - Red Teaming - Gemini Models.Languages : en-IN, en-US, hi-IN,es-MX, ja-JP, jo-KO.Experience in Gemini model response red teaming. Strong understanding of large language models (LLMs) and their...Show moreLast updated: 26 days ago
    • Promoted
    • New!
    Azure APIM Specialist

    Azure APIM Specialist

    Philodesign Technologies Incdombivli, maharashtra, in
    API solutions using Azure API Management.The ideal candidate will ensure secure, scalable, and high-performing API integrations, while driving automation and governance across the API lifecycle.Col...Show moreLast updated: 18 hours ago
    • Promoted
    Content Quant Specialist

    Content Quant Specialist

    Neo Wealth and Asset Managementmumbai, maharashtra, in
    As our Content Quant, you’ll design the logic - the conditions, triggers, and signals - that make our AI surface high-quality trading setups in real time. Think less “reports,” more “automated signa...Show moreLast updated: 8 days ago
    • Promoted
    User Experience Designer

    User Experience Designer

    E-SolutionsThane, IN
    Role : UI / UX Design Evaluator – Stitch Projects.Evaluate AI-generated design projects in Stitch.For each prompt (from the provided spreadsheet) : . Select the correct device mode (Mobile / Desktop) and d...Show moreLast updated: 17 days ago
    • Promoted
    Partner Integration and API Optimisation Specialist

    Partner Integration and API Optimisation Specialist

    B2BHolidaysKalyan-Dombivli, IN
    London-based travel technology company providing global flight and hotel services to online travel agencies and government organizations. We specialise in delivering seamless, scalable API integrati...Show moreLast updated: 27 days ago
    • Promoted
    Data QA Specialist

    Data QA Specialist

    YipitDataMumbai, India
    YipitData is the market-leading data and analytics firm.We analyze billions of data points every day to provide accurate, detailed insights across industries, including consumer brands, technology,...Show moreLast updated: 30+ days ago
    • Promoted
    Practice Lead

    Practice Lead

    Zensar Technologiesthane, maharashtra, in
    Technology & Delivery Leadership.NET practice strategy across modern engineering initiatives.NET 6+, Azure PaaS services, microservices, and event-driven patterns. Drive AI-first engineering practic...Show moreLast updated: 26 days ago
    • Promoted
    Technical Lead

    Technical Lead

    WebMDmumbai, maharashtra, in
    Expert-level proficiency with JavaScript, HTML5, and CSS / SCSS.Experience with front-end build tools and module bundlers (Webpack, Rollup, Vite). Expertise with version control systems, particularly ...Show moreLast updated: 30+ days ago
    • Promoted
    Search Engine Optimization Team Lead

    Search Engine Optimization Team Lead

    Interactive AvenuesMumbai, Maharashtra, India
    Website Implementation, Analysis and Reviewing.We are looking for an SEO who will work on key strategic domestic and international SEO projects. Candidate will be responsible for Comprehensive keywo...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Director- Product Design Team

    Senior Director- Product Design Team

    WNSKalyan-Dombivli, IN
    WNS Next is committed to shaping the future of our company by designing and releasing intuitive and powerful solutions that empower both our internal teams and external users.As the Senior Director...Show moreLast updated: 26 days ago
    • Promoted
    • New!
    Peoplesoft Technical Lead

    Peoplesoft Technical Lead

    WeConnectmumbai city, maharashtra, in
    Provide functional and technical application support.Lead and coordinate technical development activities.Collaborate with the IT team to analyze and implement business requirements.Ensure timely c...Show moreLast updated: 18 hours ago