Talent.com
This job offer is not available in your country.
QA / Red Teaming Expert

QA / Red Teaming Expert

Innodata Inc.Aurangabad, IN
11 days ago
Job description

Job Description :

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI / LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title : - Red Teaming, Prompt Evaluation, or AI / LLM Quality Assurance Expert

Key Responsibilities :

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements :

  • Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance , content review, or test case development for AI / ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
  • Preferred Qualifications :

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.
  • Background in linguistics, psychology, or computational ethics is a plus.

    Kindly Attempt the below assessment to proceed further with your application.

  • https : / / icap.innodata.com / registerfreelancer?enc=oUTZVsr / Pnz / 0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel
  • Create a job alert for this search

    Expert • Aurangabad, IN

    Related jobs
    • Promoted
    Senior QA Test Engineer - Full remote - contractor in USD

    Senior QA Test Engineer - Full remote - contractor in USD

    All European CareersAurangabad, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior QA Test Engineer with +8 years of experience. We are looking for a motivated contractor.Candidates need to b...Show moreLast updated: 30+ days ago
    • Promoted
    ThingWorx Developer

    ThingWorx Developer

    Samay ConsultingAurangabad, IN
    ThingWorx in the context of Windchill 13.Ability to create complex UI and integrate with Rest Service Calls.Windchill UI Customization- Validation, UI building, Form Processors.Windchill Listeners-...Show moreLast updated: 6 days ago
    • Promoted
    Security Engineer (Red Team)

    Security Engineer (Red Team)

    Crossing HurdlesAurangabad, IN
    Your focus will be to uncover vulnerabilities, prompt-injection pathways, and data-exfiltration risks before adversaries do. Design and automate multi-turn attacks involving browser, terminal, and A...Show moreLast updated: 6 days ago
    • Promoted
    Sr. Fullstack engineer

    Sr. Fullstack engineer

    Relevance LabAurangabad, IN
    Design, develop, and maintain our AI Agents platform using Python, FastAPI, React, and TypeScript.Collaborate with cross-functional teams, including product managers, designers, and backend enginee...Show moreLast updated: 30+ days ago
    • Promoted
    OpenLink Endur Findur QA (Consultant / Senior / Principal Consultant)

    OpenLink Endur Findur QA (Consultant / Senior / Principal Consultant)

    KWA AnalyticsAurangabad, IN
    About KWA Analytics : We are a global organisation offering a comprehensive range of consulting services for trade lifecycle management to clients involved in energy, commodities, shipping, treasury...Show moreLast updated: 30+ days ago
    • Promoted
    SAP QM Consultant - Expert

    SAP QM Consultant - Expert

    DecskillAurangabad, IN
    Decskill was founded in 2014 as an IT Consulting Company and their main mission is to delivery value through the knowledge. We enable companies to meet the challenges of digital world by providing o...Show moreLast updated: 6 days ago
    • Promoted
    User Acquisition Specialist (Remote : India)

    User Acquisition Specialist (Remote : India)

    CleverXAurangabad, IN
    Remote
    CleverX is an AI-powered research platform that connects researchers to participants for online surveys, interviews and product testing. CleverX is one of the leading companies in it's space with of...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Technical Consultant (AI & Integrations)

    Senior Technical Consultant (AI & Integrations)

    89 SolutionsAurangabad, IN
    About Moveworks & 89 Solutions.Enterprise Agentic AI platform.IT, HR, Finance, Marketing etc).It offers an AI assistant that integrates with all applications in a company and helps employees to fin...Show moreLast updated: 30+ days ago
    • Promoted
    Design Specialist

    Design Specialist

    Cactus CommunicationsAurangabad, IN
    Digital Media Solutions (DMS) works with scientists, universities, organizations, societies, and publishers across more than 150 accounts from around the world. At DMS, we work with different stakeh...Show moreLast updated: 30+ days ago
    • Promoted
    GenAI Analyst (Content Moderation)

    GenAI Analyst (Content Moderation)

    iMerit TechnologyAurangabad, IN
    Job Role : Multimodal GenAI Evaluation Analyst.Merit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs ac...Show moreLast updated: 6 days ago
    • Promoted
    Microsoft Teams Room

    Microsoft Teams Room

    CapgeminiAurangabad, IN
    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues...Show moreLast updated: 6 days ago
    • Promoted
    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Backgammon GalaxyAurangabad, IN
    Backgammon Galaxy (backgammongalaxy.Remote (HQ in Cyprus) | Full-time.Backgammon Galaxy is the leading web and mobile platform for playing backgammon, with a community of 150,000+ players worldwide...Show moreLast updated: 27 days ago
    • Promoted
    User Experience Designer

    User Experience Designer

    E-SolutionsAurangabad, IN
    Role : UI / UX Design Evaluator – Stitch Projects.Evaluate AI-generated design projects in Stitch.For each prompt (from the provided spreadsheet) : . Select the correct device mode (Mobile / Desktop) and d...Show moreLast updated: 27 days ago
    • Promoted
    Senior Network Engineer L3-L4

    Senior Network Engineer L3-L4

    BoffinHive TechnologiesAurangabad, IN
    The professional services role which works on client engagements from initial design through implementation and migration and continues to provide operational support. This ensures a seamless transi...Show moreLast updated: 15 days ago
    • Promoted
    AI Team Web Developer — React / Tailwind (SaaS)

    AI Team Web Developer — React / Tailwind (SaaS)

    Visual AIdAurangabad, IN
    Visual AID is a startup pioneering AI-driven cosmetic surgery planning, focusing on developing a bias-free, inclusive Novel Human-Face Medical Model through rigorous research and medical testing.By...Show moreLast updated: 11 days ago
    • Promoted
    Website Optimization Specialist

    Website Optimization Specialist

    Textellent, Inc.Aurangabad, IN
    Full Time | 100% Work From Home / Remote | US Office Hours.Textellent is seeking a detail-oriented and technically skilled . Website Optimization Specialist.In this newly created role, you will serve ...Show moreLast updated: 30+ days ago
    • Promoted
    Saviynt IGA Engineer / Developer - Identity Governance & Administration (IGA)

    Saviynt IGA Engineer / Developer - Identity Governance & Administration (IGA)

    SentinelAurangabad, IN
    Saviynt IGA Engineer / Developer - Identity Governance & Administration (IGA).The security function of a world renowned manufacturing organisation for power tools is seeking a Saviynt IGA Engineer ...Show moreLast updated: 11 days ago
    • Promoted
    Technical Specialist

    Technical Specialist

    BirlasoftAurangabad, IN
    Perform hands-on design and development for portal sites.Support activities for portal sites with focus on feature-rich design, usability, and site performance. Deliver solutions based on requiremen...Show moreLast updated: 30+ days ago