Talent.com
This job offer is not available in your country.
QA / Red Teaming Expert

QA / Red Teaming Expert

Innodata Inc.Hyderabad, IN
10 hours ago
Job description

Job Description :

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI / LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title : - Red Teaming, Prompt Evaluation, or AI / LLM Quality Assurance Expert

Key Responsibilities :

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements :

  • Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance , content review, or test case development for AI / ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
  • Preferred Qualifications :

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.
  • Background in linguistics, psychology, or computational ethics is a plus.

    Kindly Attempt the below assessment to proceed further with your application.

  • https : / / icap.innodata.com / registerfreelancer?enc=oUTZVsr / Pnz / 0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel
  • Create a job alert for this search

    Expert • Hyderabad, IN

    Related jobs
    • Promoted
    QA Compliance Expert - Reg CMC Facilitator

    QA Compliance Expert - Reg CMC Facilitator

    ConfidentialHyderabad / Secunderabad, Telangana
    Maintaining close cooperation with RA CMC to discuss regulatory requirements, strategies and knowledge of global product dossiers to stay up-to-date. Conducting training to ensure appropriate knowle...Show moreLast updated: 26 days ago
    • Promoted
    Red Teaming - Gemini Model Specialist

    Red Teaming - Gemini Model Specialist

    TPhyderabad, telangana, in
    Role - Red Teaming - Gemini Models.Languages : en-IN, en-US, hi-IN,es-MX, ja-JP, jo-KO.Experience in Gemini model response red teaming. Strong understanding of large language models (LLMs) and their...Show moreLast updated: 26 days ago
    • Promoted
    Analytics Programming Team Lead

    Analytics Programming Team Lead

    ConfidentialHyderabad / Secunderabad, Telangana
    R and its packages, will help you successfully deliver cutting edge Shiny application to support modern drug development programs. You will contribute to multiple projects aimed at improving the eff...Show moreLast updated: 30+ days ago
    • Promoted
    Integration Specialist

    Integration Specialist

    ValueLabshyderabad, telangana, in
    Role : Azure Integration Developer.Design and Develop Integrations.Design and develop integrations using Azure Service Bus, Logic Apps, Power Automate, Power Apps, Azure Functions, and ADF.Develop A...Show moreLast updated: 24 days ago
    • Promoted
    Senior Executive IT

    Senior Executive IT

    Premier Energies LimitedRangareddy, Telangana, India
    Founded in 1995, Premier Energies is a leading solar cell and module manufacturer based in Telangana, India.We operate advanced facilities with 2 GW cell and 5. GW module capacity, and are expanding...Show moreLast updated: 3 days ago
    • Promoted
    Quality Team Lead

    Quality Team Lead

    Tech MahindraHyderabad, Telangana, India
    Roles and Responsibilities : Team Leadership & Development : To lead and line-manage a team of IQAs, directing, guiding, and providing performance feedback to achieve high-quality output.Quality Ove...Show moreLast updated: 7 days ago
    • Promoted
    Data Architect / Data Modeler

    Data Architect / Data Modeler

    INUMELLAS CONSULTANCY SERVICES PRIVATE LIMITEDHyderabad,Bangalore,Chennai
    Role - Data Architect / Data Modeler Exp - 12 to 16 Yrs Locations - Chennai, Hyderabad, Bengaluru, Delhi, Pun...Show moreLast updated: 21 days ago
    • Promoted
    Team Lead HCM Implementation Consultant

    Team Lead HCM Implementation Consultant

    ConfidentialHyderabad / Secunderabad, Telangana
    Understanding the overall data extraction / transformation / load process of existing ADP clients & new logos for NexGen ADP application. Developing the overall process of Data & Balance conversion on D...Show moreLast updated: 5 days ago
    • Promoted
    Team Lead, Cloud

    Team Lead, Cloud

    ConfidentialHyderabad / Secunderabad, Telangana
    We are seeking a dedicated and enthusiastic Technical Lead to join our innovative team developing the Infor Mongoose platform. Mongoose is Infor s rapid application development platform, enabling ou...Show moreLast updated: 20 days ago
    • Promoted
    • New!
    Peoplesoft Technical Lead

    Peoplesoft Technical Lead

    WeConnectsecunderabad, telangana, in
    Provide functional and technical application support.Lead and coordinate technical development activities.Collaborate with the IT team to analyze and implement business requirements.Ensure timely c...Show moreLast updated: 6 hours ago
    • Promoted
    SDET

    SDET

    Sails Software IncHyderabad, Telangana, India
    We are looking for a highly skilled and detail-oriented SDET (Software Development Engineer in Test) with 5–7 years of experience in both manual and automation testing. The ideal candidate should ha...Show moreLast updated: 30+ days ago
    • Promoted
    QA Specialist

    QA Specialist

    IKCON DIGITAL IT SERVICES PRIVATE LIMITEDHyderabad
    Job description : Summary : The QA Specialist is responsible for ensuring the quality, security, and performance of all soft...Show moreLast updated: 12 days ago
    • Promoted
    Lead-Red team

    Lead-Red team

    NopalCyberHyderabad, India
    NopalCyber makes cybersecurity manageable, affordable, reliable, and powerful for companies that need to be resilient and compliant. Through Managed Extended Detection and Response (MXDR), Attack Su...Show moreLast updated: 5 days ago
    • Promoted
    Core.NET Technologies

    Core.NET Technologies

    Tata Consultancy ServicesHyderabad, IN
    Required Technical Skill Set • •.Net Core, C#,Web API and Entity Framework , MS SQL ,.Desired Competencies (Technical / Behavioral Competency). Ideally should not be more than 3-5).Strong analytical and...Show moreLast updated: 20 days ago
    • Promoted
    SAP CPQ Platform Architect ( REMOTE)

    SAP CPQ Platform Architect ( REMOTE)

    ADV TECHMINDSHyderabad, Telangana, India
    Role : SAP CPQ Platform Architect.Design and develop SAP B1 processes and programs, BOYUM & Add-ons using DI UI APIs, ASP. NET, Web Services, Visual Studio, and HANA.Execute assigned tasks as a Cert...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Team Lead (MT710ST RM 3461)

    Technical Team Lead (MT710ST RM 3461)

    ConfidentialHyderabad / Secunderabad, Telangana
    Lead and mentor a team of software developers, ensuring best practices in coding and design.Design, develop, and maintain scalable web applications using C#, ASP. Implement and manage RESTful APIs t...Show moreLast updated: 9 days ago
    • Promoted
    OpenText Captiva / Intelligent Capture

    OpenText Captiva / Intelligent Capture

    Capgeminihyderabad, telangana, in
    Over 5 years of hands-on experience with.OpenText Captiva / Intelligent Capture.In-depth knowledge of core Captiva components including. Experienced in designing and implementing new or migrated wor...Show moreLast updated: 6 days ago
    • Promoted
    US Workday HR Administrator

    US Workday HR Administrator

    ERPAUppal, Telangana, India
    Workday Implementation Partner (CMMI Level 3 company) with more than 20 years of expertise and virtuosity into PeopleSoft, Workday, Oracle Affiliates, BI, Analytics and Big Data Practice, Microsoft...Show moreLast updated: 6 days ago