Talent.com
This job offer is not available in your country.
QA / Red Teaming Expert

QA / Red Teaming Expert

Innodata Inc.Delhi, IN
6 hours ago
Job description

Job Description :

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI / LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title : - Red Teaming, Prompt Evaluation, or AI / LLM Quality Assurance Expert

Key Responsibilities :

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements :

  • Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance , content review, or test case development for AI / ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
  • Preferred Qualifications :

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.
  • Background in linguistics, psychology, or computational ethics is a plus.

    Kindly Attempt the below assessment to proceed further with your application.

  • https : / / icap.innodata.com / registerfreelancer?enc=oUTZVsr / Pnz / 0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel
  • Create a job alert for this search

    Expert • Delhi, IN

    Related jobs
    • Promoted
    IPaas Integration Developer

    IPaas Integration Developer

    AS Technology CorporationDelhi, IN
    Customer Integration Specialist (iPaaS / API Integrations).Must be able to work Eastern Time hours.Position Type : We are seeking a technically skilled and customer-oriented Customer Integration Spe...Show moreLast updated: 7 days ago
    • Promoted
    Partner Integration and API Optimisation Specialist

    Partner Integration and API Optimisation Specialist

    B2BHolidaysDelhi, IN
    London-based travel technology company providing global flight and hotel services to online travel agencies and government organizations. We specialise in delivering seamless, scalable API integrati...Show moreLast updated: 26 days ago
    • Promoted
    User Acquisition Specialist (Remote : India)

    User Acquisition Specialist (Remote : India)

    CleverXDelhi, IN
    Remote
    CleverX is an AI-powered research platform that connects researchers to participants for online surveys, interviews and product testing. CleverX is one of the leading companies in it's space with of...Show moreLast updated: 30+ days ago
    • Promoted
    Core.NET Technologies

    Core.NET Technologies

    Tata Consultancy ServicesDelhi, IN
    Required Technical Skill Set • •.Net Core, C#,Web API and Entity Framework , MS SQL ,.Desired Competencies (Technical / Behavioral Competency). Ideally should not be more than 3-5).Strong analytical and...Show moreLast updated: 20 days ago
    • Promoted
    Senior Network Engineer L3-L4

    Senior Network Engineer L3-L4

    BoffinHive TechnologiesDelhi, IN
    The professional services role which works on client engagements from initial design through implementation and migration and continues to provide operational support. This ensures a seamless transi...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    IAM Senior Engineer – CyberArk / Privileged Access Management (PAM)

    IAM Senior Engineer – CyberArk / Privileged Access Management (PAM)

    PerfictDelhi, IN
    The IAM Senior Engineer will be responsible for the service design, build, deploy, and support of key elements of the Privileged Access Management (PAM) platform built leveraging the CyberArk Cloud...Show moreLast updated: 6 hours ago
    • Promoted
    QA Lead - Network Protocols & Automation (Routing & Switching, Python)

    QA Lead - Network Protocols & Automation (Routing & Switching, Python)

    ConfidentialGurugram, Gurgaon / Gurugram, India
    As the global leader in high-speed connectivity, Ciena is committed to a people-first approach.Our teams enjoy a culture focused on prioritizing a flexible work environment that empowers individual...Show moreLast updated: 9 days ago
    • Promoted
    • New!
    Security Consultant (Red Teamer)

    Security Consultant (Red Teamer)

    ChaleitDelhi, IN
    We're hiring a Specialist Red Teamer to join Chaleit Services.If you have 4–8 years of hands-on offensive security experience and love emulating real adversaries to harden defences, we want to talk...Show moreLast updated: 6 hours ago
    • Promoted
    Website Optimization Specialist

    Website Optimization Specialist

    Textellent, Inc.Delhi, IN
    Full Time | 100% Work From Home / Remote | US Office Hours.Textellent is seeking a detail-oriented and technically skilled . Website Optimization Specialist.In this newly created role, you will serve ...Show moreLast updated: 19 days ago
    • Promoted
    Lead Generation Expert

    Lead Generation Expert

    Mariox SoftwareNarela, Delhi, India
    We are looking for a motivated Lead Generation Specialist with 1+ year experience in international IT Leads Generation (App & Web Development) using platforms like LinkedIn Sales Navigator, A...Show moreLast updated: 30+ days ago
    • Promoted
    DDI Engineer - 100% Remote Work

    DDI Engineer - 100% Remote Work

    TWO95 International, IncDelhi, IN
    Remote
    Expertise designing, transforming, managing, and migrating complex Environments.Been technical lead & completed at least 3 implantations / migrations. Expert understanding of Network Services, DNS, DH...Show moreLast updated: 23 days ago
    • Promoted
    Sr. CyberArk Engineer

    Sr. CyberArk Engineer

    CyberSolveDelhi, IN
    CyberSolve is a fastest growing IAM Specialist firm in the US with aspirations of becoming the world's largest company in the IAM space. CyberSolve’s 350+ specialists solve interesting puzzles in IG...Show moreLast updated: 16 days ago
    • Promoted
    Technical Specialist

    Technical Specialist

    BirlasoftDelhi, IN
    Perform hands-on design and development for portal sites.Support activities for portal sites with focus on feature-rich design, usability, and site performance. Deliver solutions based on requiremen...Show moreLast updated: 23 days ago
    • Promoted
    Presales Team Lead

    Presales Team Lead

    AccopsDelhi, India, India
    Education Qualification : MBA / MBA -Marketing / BE / B.Should have team management experience with leading, mentoring, and managing the Presales team, ensuring that team members are motivated, skilled...Show moreLast updated: 30+ days ago
    • Promoted
    Design Specialist

    Design Specialist

    Cactus CommunicationsDelhi, IN
    Digital Media Solutions (DMS) works with scientists, universities, organizations, societies, and publishers across more than 150 accounts from around the world. At DMS, we work with different stakeh...Show moreLast updated: 26 days ago
    • Promoted
    Azure Integration Services

    Azure Integration Services

    VicTree SolutionsGhaziabad, IN
    Strong experience with Azure Integration Services (e.Logic Apps, Azure Functions, APIM, Service Bus, Event Grid).Experience in developing Azure Functions (serverless) for event-driven or API-based ...Show moreLast updated: 4 days ago
    • Promoted
    OpenLink Endur Findur QA (Consultant / Senior / Principal Consultant)

    OpenLink Endur Findur QA (Consultant / Senior / Principal Consultant)

    KWA AnalyticsDelhi, IN
    About KWA Analytics : We are a global organisation offering a comprehensive range of consulting services for trade lifecycle management to clients involved in energy, commodities, shipping, treasury...Show moreLast updated: 19 days ago
    • Promoted
    Technical Lead

    Technical Lead

    Servion Global SolutionsDelhi, IN
    We’re Hiring : Genesys PureConnect Engineer!!.Strong background in troubleshooting, support, and maintenance of Genesys PureConnect environments. Bachelor’s degree or equivalent in Computer Science o...Show moreLast updated: 18 days ago