Talent.com
QA / Red Teaming Expert

QA / Red Teaming Expert

Innodata Inc.Vijayawada, IN
29 days ago
Job description

Job Description :

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI / LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title : - Red Teaming, Prompt Evaluation, or AI / LLM Quality Assurance Expert

Key Responsibilities :

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements :

  • Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance , content review, or test case development for AI / ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
  • Preferred Qualifications :

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.
  • Background in linguistics, psychology, or computational ethics is a plus.

    Kindly Attempt the below assessment to proceed further with your application.

  • https : / / icap.innodata.com / registerfreelancer?enc=oUTZVsr / Pnz / 0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel
  • Create a job alert for this search

    Expert • Vijayawada, IN

    Related jobs
    • Promoted
    QA / Red Teaming Expert

    QA / Red Teaming Expert

    Innodata Inc.Guntur, IN
    We are seeking highly analytical and detail-oriented professionals with hands-on experience in.Red Teaming, Prompt Evaluation. The ideal candidate will help us rigorously test and evaluate AI-genera...Show moreLast updated: 29 days ago
    • Promoted
    Ericsson Packet Core Expert

    Ericsson Packet Core Expert

    Tangent InternationalVijayawada, IN
    Tangent International are urgently looking for a Ericsson Packet Core Expert to work a 4 month rolling contract based in Australia (Remote can be considered). The overall scope of services is estima...Show moreLast updated: 14 days ago
    • Promoted
    Integration Developer

    Integration Developer

    Vriba SolutionsVijayawada, IN
    PM IST to 3 : 30 AM IST (US Shift).Immediate joiners preferred (15–30 days max).We are looking for an experienced.Integration Developer (5–10 years). The role requires working closely with cross-funct...Show moreLast updated: 30+ days ago
    • Promoted
    Microsoft Teams Room

    Microsoft Teams Room

    CapgeminiGuntur, IN
    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues...Show moreLast updated: 25 days ago
    • Promoted
    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Backgammon GalaxyGuntur, IN
    Backgammon Galaxy (backgammongalaxy.Remote (HQ in Cyprus) | Full-time.Backgammon Galaxy is the leading web and mobile platform for playing backgammon, with a community of 150,000+ players worldwide...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Technical Consultant (AI & Integrations)

    Senior Technical Consultant (AI & Integrations)

    89 SolutionsVijayawada, IN
    About Moveworks & 89 Solutions.Enterprise Agentic AI platform.IT, HR, Finance, Marketing etc).It offers an AI assistant that integrates with all applications in a company and helps employees to fin...Show moreLast updated: 30+ days ago
    • Promoted
    Specialist - Privacy Implementation

    Specialist - Privacy Implementation

    Baldor Technologies Private Limited (IDfy)Vijayawada, IN
    IDfy is Asia’s leading TrustStack, trusted by the best, with global expertise and enterprise-grade tech, we’re solving trust challenges, making compliance easy,fraud detection smarter, and onboardi...Show moreLast updated: 14 days ago
    • Promoted
    Senior Technical Consultant

    Senior Technical Consultant

    R SystemsVijayawada, IN
    Our product mindset and advanced engineering capabilities in.Customer Experience empower us to deliver innovative solutions to key players across the high-tech industry. This includes ISVs, SaaS, an...Show moreLast updated: 12 days ago
    • Promoted
    AppScan Product _Lead SDET_Remote Location

    AppScan Product _Lead SDET_Remote Location

    HCLSoftwareEluru, IN
    Remote
    HCL Software” : - Is a Product Development Division of HCL Tech : That operates its primary Software business.At HCL Software we Develop, Market, Sell and Support over 20 Product families in the area...Show moreLast updated: 23 days ago
    • Promoted
    OpenText Core Capture Consultant

    OpenText Core Capture Consultant

    Optima ConsultingEluru, IN
    OpenText Core Capture Consultant.Home Office anywhere (works in US time zone).Reports to : Practice Director - ECM and IT Services. We are seeking an experienced OpenText Core Capture Consultant to d...Show moreLast updated: 4 days ago
    • Promoted
    Webex CC

    Webex CC

    Servion Global SolutionsGuntur, IN
    As a Senior Applications Developer, this position partners with customers to design and implement Cisco contact center applications and IVR call flows. Rather than focusing on infrastructure, this r...Show moreLast updated: 14 days ago
    • Promoted
    ABAP Technical Consultant

    ABAP Technical Consultant

    Quantum IntegratorsEluru, IN
    RAP, CDS Views, AMDP, OData Services, Smart Forms, Enhancements, and BAPIs.Show moreLast updated: 14 days ago
    • Promoted
    OpenLink Endur Findur QA (Consultant / Senior / Principal Consultant)

    OpenLink Endur Findur QA (Consultant / Senior / Principal Consultant)

    KWA AnalyticsEluru, IN
    About KWA Analytics : We are a global organisation offering a comprehensive range of consulting services for trade lifecycle management to clients involved in energy, commodities, shipping, treasury...Show moreLast updated: 30+ days ago
    • Promoted
    EDI Specialist with OpenText

    EDI Specialist with OpenText

    DroisysGuntur, IN
    Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agil...Show moreLast updated: 11 days ago
    • Promoted
    Technical Implementation Engineer

    Technical Implementation Engineer

    Y MeadowsEluru, IN
    Technical Implementation Engineer.Y Meadows is a United States-based company specializing in artificial intelligence and automation solutions. We provide a low-code automation platform that streamli...Show moreLast updated: 13 days ago
    • Promoted
    SAP QM Consultant - Expert

    SAP QM Consultant - Expert

    DecskillGuntur, IN
    Decskill was founded in 2014 as an IT Consulting Company and their main mission is to delivery value through the knowledge. We enable companies to meet the challenges of digital world by providing o...Show moreLast updated: 25 days ago
    • Promoted
    Offshore Data Integration QA (SFMC / IICS / Veeva)

    Offshore Data Integration QA (SFMC / IICS / Veeva)

    BusyQAGuntur, IN
    Job Description – Offshore Data.Integration QA (SFMC / IICS / Veeva).We are seeking a highly skilled QA Engineer with strong expertise in ETL, APIs, and data validation to support end-to-end testin...Show moreLast updated: 4 days ago
    • Promoted
    Microsoft Power App Lead

    Microsoft Power App Lead

    Persistent SystemsVijayawada, IN
    We are Looking for Lead having good experience in implementing and leading of Microsoft power platform as part of a service-oriented architecture for managing dynamic business process.Must be profi...Show moreLast updated: 14 days ago