Talent.com
This job offer is not available in your country.
QA / Red Teaming Expert

QA / Red Teaming Expert

Innodata Inc.Bangalore, IN
8 hours ago
Job description

Job Description :

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI / LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title : - Red Teaming, Prompt Evaluation, or AI / LLM Quality Assurance Expert

Key Responsibilities :

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements :

  • Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance , content review, or test case development for AI / ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
  • Preferred Qualifications :

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.
  • Background in linguistics, psychology, or computational ethics is a plus.

    Kindly Attempt the below assessment to proceed further with your application.

  • https : / / icap.innodata.com / registerfreelancer?enc=oUTZVsr / Pnz / 0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel
  • Create a job alert for this search

    Expert • Bangalore, IN

    Related jobs
    • Promoted
    Technical Team Leader – Core Network Group (SASE)

    Technical Team Leader – Core Network Group (SASE)

    Check Point SoftwareBengaluru, Karnataka, India
    Technical Team Leader – Core Network Group (SASE).Check Point is a global leader in network security, pioneering next-generation solutions that secure millions of users and organizations worldwide....Show moreLast updated: 23 days ago
    • Promoted
    Technical Lead

    Technical Lead

    Infosys FinacleBengaluru, Karnataka, India
    Ready to Explore into the world of Digital Banking.Come and join with us and shape your career!!!.Proficiency in atleast one of the language C / C++, with OOPS, Pointers. Experience in product / softwar...Show moreLast updated: 20 days ago
    • Promoted
    Ab Initio Expert (FT Lead)

    Ab Initio Expert (FT Lead)

    ConfidentialBengaluru / Bangalore
    Researching, designing, and developing complex components for Ab Initio applications with quality coding.Interacting with analysts and end users for information requirements.Coding Ab Initio graphs...Show moreLast updated: 9 days ago
    • Promoted
    QA Lead [T500-20401]

    QA Lead [T500-20401]

    Talent500Bengaluru, Karnataka, India
    Talent500 is hiring for one of its client's.Founded in 1999 and headquartered in New York City, Huge is a global design and technology company that creates digital experiences for the world’s most ...Show moreLast updated: 7 days ago
    • Promoted
    RMS Technical Expert - OSAT

    RMS Technical Expert - OSAT

    Tata ElectronicsKolar, Karnataka, India
    The RMS Technical Expert will be responsible for the design, deployment, and optimization of Reliability Monitoring Systems in an OSAT (Outsourced Semiconductor Assembly & Test) manufacturing envir...Show moreLast updated: 7 days ago
    • Promoted
    AI Leader

    AI Leader

    Tata ElectronicsKolar, Karnataka, India
    Tata Electronics Private Limited.TEPL) is a greenfield venture of the.India’s first AI-enabled state-of-the-art Semiconductor Foundry. This facility will produce chips for applications such as power...Show moreLast updated: 7 days ago
    • Promoted
    Lead Generation Expert

    Lead Generation Expert

    Mariox Softwarebangalore, karnataka, in
    We are looking for a motivated.App & Web Development) using platforms like LinkedIn Sales Navigator, Apollo, ZoomInfo, Upwork etc. Generate and qualify leads for app & web development projects in in...Show moreLast updated: 30+ days ago
    • Promoted
    Team Lead, Ingest

    Team Lead, Ingest

    ConfidentialBengaluru / Bangalore, India
    As the world's leading multidisciplinary service provider, Deluxe underpins the media and entertainment industry, servicing content creators and distributors including Netflix, WarnerMedia, The Wal...Show moreLast updated: 9 days ago
    • Promoted
    SDET Professional

    SDET Professional

    ConfidentialBengaluru / Bangalore
    Trellix is looking for SDETs who are self-driven and passionate to work on Endpoint Detection and Response (EDR) line of products. The team is the ultimate quality gate before shipping to Customers....Show moreLast updated: 30+ days ago
    • Promoted
    Unit-Level Traceability Technical Expert – OSAT

    Unit-Level Traceability Technical Expert – OSAT

    Tata ElectronicsKolar, Karnataka, India
    Tata Electronics (a wholly owned subsidiary of Tata Sons Pvt.India’s first AI-enabled state-of-the-art Semiconductor Foundry. This facility will produce chips for applications such as power manageme...Show moreLast updated: 7 days ago
    Redhat OpenShift Engineer

    Redhat OpenShift Engineer

    Talent WorxBengaluru, KA, IN
    Quick Apply
    Title : Redhat OpenShift Engineer.We are looking for an experienced Red Hat OpenShift Subject Matter Expert (SME) to lead and support our containerized application platform initiatives.This role inv...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Consultant (5 to 7 yrs exp.) - Recruitment QA (Continuous Process improvement) - Non tech / non IT hiring exp. mandatory (US shift ONLY)

    Consultant (5 to 7 yrs exp.) - Recruitment QA (Continuous Process improvement) - Non tech / non IT hiring exp. mandatory (US shift ONLY)

    Korn FerryBengaluru, Karnataka, India
    We unlock the potential in your people and unleash transformation across your business - synchronizing strategy, operations, and talent to accelerate performance, fuel growth, and inspire a legacy ...Show moreLast updated: 8 hours ago
    • Promoted
    Automation testing-Python with Robot framework

    Automation testing-Python with Robot framework

    Tata Consultancy ServicesBangalore Rural, Karnataka, India
    TCS is looking for Automation testing-Python with Robot framework.Education : Minimum 15 years of full-time education (10th, 12th and Graduation). Responsible for Designing, Developing and executing ...Show moreLast updated: 7 days ago
    • Promoted
    Reporting Leader (Big Data / MES)

    Reporting Leader (Big Data / MES)

    Tata ElectronicsKolar, Karnataka, India
    Power BI, Tableau, and Grafana.Deliver multiple output format reports meeting OSAT customer needs.Develop portals for internal and external users to access reports with right level of access contro...Show moreLast updated: 7 days ago
    • Promoted
    FACULTY – Computer Science Engineering

    FACULTY – Computer Science Engineering

    GITAM Deemed UniversityDodda Ballapur, Karnataka, India
    Faculty Recruitment – Computer Science Engineering | GITAM (Deemed to be University), Bengaluru Campus.Department of Computer Science Engineering at GITAM. Algorithms, Complexity, Graph Theory, Form...Show moreLast updated: 3 days ago
    • Promoted
    Cloud QA Expert

    Cloud QA Expert

    ConfidentialBengaluru / Bangalore
    Strong understanding of Converged Storage management, Storage Provisioning, Storage Area Networking and System Management domain. Experience in Storage Area Networking technologies and associated pr...Show moreLast updated: 9 days ago
    • Promoted
    MES Technical Developer

    MES Technical Developer

    Tata ElectronicsKolar, Karnataka, India
    We are looking for an experienced.Senior MES Technical Developer.Siemens Opcenter Execution (formerly Camstar).MES solutions tailored for high-tech electronics or semiconductor manufacturing.MES wo...Show moreLast updated: 7 days ago
    • Promoted
    SDET

    SDET

    MovateBengaluru, Karnataka, India
    Design, develop, and maintain automated test frameworks for web, API, and / or mobile applications.Write clean, scalable, and maintainable test code in languages such as Java, Python, JavaScript, or ...Show moreLast updated: 26 days ago