Talent.com
No longer accepting applications
QA / Red Teaming Expert

QA / Red Teaming Expert

Innodata Inc.Eluru, IN
30+ days ago
Job description

Job Description :

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI / LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title : - Red Teaming, Prompt Evaluation, or AI / LLM Quality Assurance Expert

Key Responsibilities :

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements :

  • Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance , content review, or test case development for AI / ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
  • Preferred Qualifications :

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.
  • Background in linguistics, psychology, or computational ethics is a plus.

    Kindly Attempt the below assessment to proceed further with your application.

  • https : / / icap.innodata.com / registerfreelancer?enc=oUTZVsr / Pnz / 0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel
  • Create a job alert for this search

    Expert • Eluru, IN

    Related jobs
    • Promoted
    AI-First QA Engineer (with Business Analysis Expertise)

    AI-First QA Engineer (with Business Analysis Expertise)

    CESeluru, India
    The role focuses on building quality from the first requirement using.You’ll work closely with product and development teams, using an AI-first approach to make testing faster, sharper, and more ef...Show moreLast updated: 8 days ago
    • Promoted
    Healthcare Integration Specalist

    Healthcare Integration Specalist

    Lenia HealthEluru, Andhra Pradesh, India
    About Lenia Health We’re a fast-growing healthcare data services company focused on secure, intelligent data exchange.By simplifying interoperability and automating workflows, we help healthcare or...Show moreLast updated: 1 day ago
    • Promoted
    SAP QM Consultant - Expert

    SAP QM Consultant - Expert

    DecskillVijayawada, IN
    Decskill was founded in 2014 as an IT Consulting Company and their main mission is to delivery value through the knowledge. We enable companies to meet the challenges of digital world by providing o...Show moreLast updated: 25 days ago
    • Promoted
    Integration Developer

    Integration Developer

    Vriba SolutionsEluru, IN
    PM IST to 3 : 30 AM IST (US Shift).Immediate joiners preferred (15–30 days max).We are looking for an experienced.Integration Developer (5–10 years). The role requires working closely with cross-funct...Show moreLast updated: 30+ days ago
    • Promoted
    Offshore Data Integration QA (SFMC / IICS / Veeva)

    Offshore Data Integration QA (SFMC / IICS / Veeva)

    BusyQAEluru, IN
    Job Description – Offshore Data.Integration QA (SFMC / IICS / Veeva).We are seeking a highly skilled QA Engineer with strong expertise in ETL, APIs, and data validation to support end-to-end testin...Show moreLast updated: 4 days ago
    • Promoted
    Databricks+ Unity Catalog+ CDGC

    Databricks+ Unity Catalog+ CDGC

    Mastech DigitalVijayawada, IN
    Unity Catalog + Databricks+ Informatica(CDGC).Full Time and Full time Contractors (Both option available).Only Immediate Joiners / Currently Serving Notice / Notice is less than 30 days.Primary - Uni...Show moreLast updated: 30+ days ago
    • Promoted
    EDI Specialist with OpenText

    EDI Specialist with OpenText

    DroisysVijayawada, IN
    Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agil...Show moreLast updated: 11 days ago
    • Promoted
    SDET

    SDET

    QualityKiosk Technologieseluru, India
    Proven ability to design, implement, and maintain diverse test automation frameworks.Experience in API testing( optional), including validation of request / response flows and.Strong understanding of...Show moreLast updated: 8 days ago
    • Promoted
    Technical Architect Team Lead

    Technical Architect Team Lead

    QNOPY Inc.vijayawada, India
    We are seeking an experienced Technical Team Lead with a strong background in delivering SaaS products to lead our engineering team. The ideal candidate has 7+ years of hands-on experience in softwa...Show moreLast updated: 1 day ago
    • Promoted
    OpenLink Endur Findur QA (Consultant / Senior / Principal Consultant)

    OpenLink Endur Findur QA (Consultant / Senior / Principal Consultant)

    KWA AnalyticsEluru, IN
    About KWA Analytics : We are a global organisation offering a comprehensive range of consulting services for trade lifecycle management to clients involved in energy, commodities, shipping, treasury...Show moreLast updated: 30+ days ago
    • Promoted
    Specialist - Privacy Implementation

    Specialist - Privacy Implementation

    Baldor Technologies Private Limited (IDfy)Eluru, IN
    IDfy is Asia’s leading TrustStack, trusted by the best, with global expertise and enterprise-grade tech, we’re solving trust challenges, making compliance easy,fraud detection smarter, and onboardi...Show moreLast updated: 15 days ago
    • Promoted
    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Backgammon GalaxyVijayawada, IN
    Backgammon Galaxy (backgammongalaxy.Remote (HQ in Cyprus) | Full-time.Backgammon Galaxy is the leading web and mobile platform for playing backgammon, with a community of 150,000+ players worldwide...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Technical Consultant

    Senior Technical Consultant

    R SystemsEluru, IN
    Our product mindset and advanced engineering capabilities in.Customer Experience empower us to deliver innovative solutions to key players across the high-tech industry. This includes ISVs, SaaS, an...Show moreLast updated: 12 days ago
    • Promoted
    OpenText Core Capture Consultant

    OpenText Core Capture Consultant

    Optima ConsultingVijayawada, IN
    OpenText Core Capture Consultant.Home Office anywhere (works in US time zone).Reports to : Practice Director - ECM and IT Services. We are seeking an experienced OpenText Core Capture Consultant to d...Show moreLast updated: 4 days ago
    • Promoted
    Senior Technical Consultant (AI & Integrations)

    Senior Technical Consultant (AI & Integrations)

    89 SolutionsEluru, IN
    About Moveworks & 89 Solutions.Enterprise Agentic AI platform.IT, HR, Finance, Marketing etc).It offers an AI assistant that integrates with all applications in a company and helps employees to fin...Show moreLast updated: 30+ days ago
    • Promoted
    Webex CC

    Webex CC

    Servion Global SolutionsVijayawada, IN
    As a Senior Applications Developer, this position partners with customers to design and implement Cisco contact center applications and IVR call flows. Rather than focusing on infrastructure, this r...Show moreLast updated: 15 days ago
    • Promoted
    Microsoft Power App Lead

    Microsoft Power App Lead

    Persistent SystemsVijayawada, IN
    We are Looking for Lead having good experience in implementing and leading of Microsoft power platform as part of a service-oriented architecture for managing dynamic business process.Must be profi...Show moreLast updated: 15 days ago
    • Promoted
    AppScan Product _Lead SDET_Remote Location

    AppScan Product _Lead SDET_Remote Location

    HCLSoftwareVijayawada, Andhra Pradesh, India
    HCL Software” : - Is a Product Development Division of HCL Tech : That operates its primary Software business.At HCL Software we Develop, Market, Sell and Support over 20 Product families in the area...Show moreLast updated: 1 day ago