Talent.com
This job offer is not available in your country.
QA / Red Teaming Expert

QA / Red Teaming Expert

Innodata Inc.Pune, IN
1 day ago
Job description

Job Description :

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI / LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title : - Red Teaming, Prompt Evaluation, or AI / LLM Quality Assurance Expert

Key Responsibilities :

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements :

  • Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance , content review, or test case development for AI / ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
  • Preferred Qualifications :

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.
  • Background in linguistics, psychology, or computational ethics is a plus.

    Kindly Attempt the below assessment to proceed further with your application.

  • https : / / icap.innodata.com / registerfreelancer?enc=oUTZVsr / Pnz / 0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel
  • Create a job alert for this search

    Expert • Pune, IN

    Related jobs
    • Promoted
    Azure APIM Specialist

    Azure APIM Specialist

    Philodesign Technologies Incpune, maharashtra, in
    API solutions using Azure API Management.The ideal candidate will ensure secure, scalable, and high-performing API integrations, while driving automation and governance across the API lifecycle.Col...Show moreLast updated: 1 day ago
    • Promoted
    Lead Generation Expert

    Lead Generation Expert

    Mariox Softwarepune, maharashtra, in
    We are looking for a motivated.App & Web Development) using platforms like LinkedIn Sales Navigator, Apollo, ZoomInfo, Upwork etc. Generate and qualify leads for app & web development projects in in...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Integration Services

    Azure Integration Services

    VicTree SolutionsPune, IN
    Strong experience with Azure Integration Services (e.Logic Apps, Azure Functions, APIM, Service Bus, Event Grid).Experience in developing Azure Functions (serverless) for event-driven or API-based ...Show moreLast updated: 6 days ago
    • Promoted
    Red Teaming - Gemini Model Specialist

    Red Teaming - Gemini Model Specialist

    TPpune, maharashtra, in
    Role - Red Teaming - Gemini Models.Languages : en-IN, en-US, hi-IN,es-MX, ja-JP, jo-KO.Experience in Gemini model response red teaming. Strong understanding of large language models (LLMs) and their...Show moreLast updated: 27 days ago
    • Promoted
    QA Design Specialist

    QA Design Specialist

    Cybage SoftwarePune, Maharashtra, India
    Cybage has a mature testing practice with a strong team working on verification and validation of some of the most complex products. We are looking for sharp engineers with an aptitude for learning ...Show moreLast updated: 1 day ago
    • Promoted
    Technical Lead

    Technical Lead

    Xponential Technology ServicesPune, Maharashtra, India
    At XTS we are redefining how learning content is created and delivered.We’re building an AI-powered SaaS platform using React, Python, OpenAI, and AWS, empowering organizations to streamline knowle...Show moreLast updated: 6 days ago
    • Promoted
    Data QA Specialist

    Data QA Specialist

    YipitDataPune, India
    YipitData is the market-leading data and analytics firm.We analyze billions of data points every day to provide accurate, detailed insights across industries, including consumer brands, technology,...Show moreLast updated: 30+ days ago
    • Promoted
    User Experience Designer

    User Experience Designer

    E-Solutionspune, maharashtra, in
    Role : UI / UX Design Evaluator – Stitch Projects.Evaluate AI-generated design projects in Stitch.For each prompt (from the provided spreadsheet) : . Select the correct device mode (Mobile / Desktop) and d...Show moreLast updated: 18 days ago
    • Promoted
    Core.NET Technologies

    Core.NET Technologies

    Tata Consultancy ServicesPune, IN
    Required Technical Skill Set • •.Net Core, C#,Web API and Entity Framework , MS SQL ,.Desired Competencies (Technical / Behavioral Competency). Ideally should not be more than 3-5).Strong analytical and...Show moreLast updated: 22 days ago
    • Promoted
    Hiring for Cyber-VAPT+Red Teaming Professionals(4-8 yrs Exp)-Pune / Mumbai

    Hiring for Cyber-VAPT+Red Teaming Professionals(4-8 yrs Exp)-Pune / Mumbai

    DeloittePune, Maharashtra, India
    India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realise your potential amongst cutting edge leaders, and organizations ...Show moreLast updated: 30+ days ago
    • Promoted
    Cerebry — GenAI Implementation Engineer (AI Growth Lead)

    Cerebry — GenAI Implementation Engineer (AI Growth Lead)

    Cerebrypune, maharashtra, in
    Transform Cerebry Research designs into.Architect, code, evaluate, and package GenAI services that power Cerebry end-to-end. Why this is exciting (Ownership-Forward).Initial grants are designed for ...Show moreLast updated: 9 days ago
    • Promoted
    Bio Process Design (Technical Sales Support) #Eng-Bio-2025-05-07-44

    Bio Process Design (Technical Sales Support) #Eng-Bio-2025-05-07-44

    DDE Bioengineering Pvt. Ltd.Pimpri Chinchwad, Maharashtra, India
    Should be on top of his / her Professional knowledge base and Flexible and Adaptable to new Technologies / Processes / Operating Systems. Passion for meeting the pre-determined Key Performance Indicat...Show moreLast updated: 30+ days ago
    • Promoted
    Practice Lead

    Practice Lead

    Zensar TechnologiesPune, Maharashtra, India
    Technology & Delivery Leadership.NET practice strategy across modern engineering initiatives.NET 6+, Azure PaaS services, microservices, and event-driven patterns. Drive AI-first engineering practic...Show moreLast updated: 30+ days ago
    • Promoted
    GenAI Lead

    GenAI Lead

    L&T FinancePune, Maharashtra, India
    GenAI Lead Engineer– Job Description.We’re looking for a GenAI lead to design, build, and deploy intelligent LLM-powered systems—from single-agent chatbots, copilots to complex multi-agent applicat...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer Team Lead

    Data Engineer Team Lead

    SGIpune, maharashtra, in
    To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 7 days ago
    • Promoted
    Expertise in Kubernetes JIS84301

    Expertise in Kubernetes JIS84301

    Krayr SolutionsPune, Maharashtra, India
    Role – Expertise in Kubernetes.This position is for developing and supporting a one-of-its-kind Kubernetes based platform that is used for hosting a number of security analytics applications.These ...Show moreLast updated: 18 days ago
    • Promoted
    Design Specialist

    Design Specialist

    Cactus CommunicationsPune, IN
    Digital Media Solutions (DMS) works with scientists, universities, organizations, societies, and publishers across more than 150 accounts from around the world. At DMS, we work with different stakeh...Show moreLast updated: 28 days ago
    • Promoted
    Peoplesoft Technical Lead

    Peoplesoft Technical Lead

    WeConnectpune, maharashtra, in
    Provide functional and technical application support.Lead and coordinate technical development activities.Collaborate with the IT team to analyze and implement business requirements.Ensure timely c...Show moreLast updated: 1 day ago