Talent.com
No longer accepting applications
QA / Red Teaming Expert

QA / Red Teaming Expert

Innodata Inc.Guntur, IN
30+ days ago
Job description

Job Description :

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI / LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title : - Red Teaming, Prompt Evaluation, or AI / LLM Quality Assurance Expert

Key Responsibilities :

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements :

  • Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance , content review, or test case development for AI / ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
  • Preferred Qualifications :

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.
  • Background in linguistics, psychology, or computational ethics is a plus.

    Kindly Attempt the below assessment to proceed further with your application.

  • https : / / icap.innodata.com / registerfreelancer?enc=oUTZVsr / Pnz / 0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel
  • Create a job alert for this search

    Expert • Guntur, IN

    Related jobs
    • Promoted
    AppScan Product _Lead SDET_Remote Location

    AppScan Product _Lead SDET_Remote Location

    HCLSoftwareGuntur, IN
    Remote
    HCL Software” : - Is a Product Development Division of HCL Tech : That operates its primary Software business.At HCL Software we Develop, Market, Sell and Support over 20 Product families in the area...Show moreLast updated: 25 days ago
    • Promoted
    Delivery Lead

    Delivery Lead

    RapidBrainsGuntur, IN
    Job Title : Portfolio Lead (Digital Delivery & Strategic Client Transformation).Remote / Hybird / Onsite as permanent employee. Company : Our Premium Client - German Based.We're seeking an experienced an...Show moreLast updated: 15 days ago
    • Promoted
    Senior AppDynamics Observability SME

    Senior AppDynamics Observability SME

    Dexian IndiaGuntur, IN
    Position Title : Senior AppDynamics Observability SME.IT operations, system administration, or engineering.Ansible, Jenkins, Terraform, Python to develop configuration, deployment, and orchestration...Show moreLast updated: 5 days ago
    • Promoted
    SAP QM Consultant - Expert

    SAP QM Consultant - Expert

    DecskillVijayawada, IN
    Decskill was founded in 2014 as an IT Consulting Company and their main mission is to delivery value through the knowledge. We enable companies to meet the challenges of digital world by providing o...Show moreLast updated: 27 days ago
    • Promoted
    Integration Developer

    Integration Developer

    Vriba SolutionsGuntur, IN
    PM IST to 3 : 30 AM IST (US Shift).Immediate joiners preferred (15–30 days max).We are looking for an experienced.Integration Developer (5–10 years). The role requires working closely with cross-funct...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Implementation Engineer

    Technical Implementation Engineer

    Y MeadowsGuntur, IN
    Technical Implementation Engineer.Y Meadows is a United States-based company specializing in artificial intelligence and automation solutions. We provide a low-code automation platform that streamli...Show moreLast updated: 15 days ago
    • Promoted
    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Backgammon GalaxyGuntur, IN
    Backgammon Galaxy (backgammongalaxy.Remote (HQ in Cyprus) | Full-time.Backgammon Galaxy is the leading web and mobile platform for playing backgammon, with a community of 150,000+ players worldwide...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks+ Unity Catalog+ CDGC

    Databricks+ Unity Catalog+ CDGC

    Mastech DigitalVijayawada, IN
    Unity Catalog + Databricks+ Informatica(CDGC).Full Time and Full time Contractors (Both option available).Only Immediate Joiners / Currently Serving Notice / Notice is less than 30 days.Primary - Uni...Show moreLast updated: 30+ days ago
    • Promoted
    EDI Specialist with OpenText

    EDI Specialist with OpenText

    DroisysGuntur, IN
    Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agil...Show moreLast updated: 13 days ago
    • Promoted
    AI-First QA Engineer (with Business Analysis Expertise)

    AI-First QA Engineer (with Business Analysis Expertise)

    CESVijayawada, IN
    The role focuses on building quality from the first requirement using.You’ll work closely with product and development teams, using an AI-first approach to make testing faster, sharper, and more ef...Show moreLast updated: 15 days ago
    • Promoted
    AI Inference Kernel Engineer (CUDA)

    AI Inference Kernel Engineer (CUDA)

    PhinityGuntur, IN
    We look forward to when AI can discover the next quantum AI accelerator, or when AI can make RL much more compute-efficient. We want to enable AI to bootstrap its own intelligence, to discover new c...Show moreLast updated: 3 days ago
    • Promoted
    Retoucher / QA & Project Coordinator

    Retoucher / QA & Project Coordinator

    MS2Guntur, IN
    MS2Creative is looking for a detail-oriented Retoucher who can also oversee quality assurance and manage project workflows. This is a dual-role position ideal for someone with strong image editing s...Show moreLast updated: 30+ days ago
    • Promoted
    OpenLink Endur Findur QA (Consultant / Senior / Principal Consultant)

    OpenLink Endur Findur QA (Consultant / Senior / Principal Consultant)

    KWA AnalyticsVijayawada, IN
    About KWA Analytics : We are a global organisation offering a comprehensive range of consulting services for trade lifecycle management to clients involved in energy, commodities, shipping, treasury...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Technical Consultant (AI & Integrations)

    Senior Technical Consultant (AI & Integrations)

    89 SolutionsGuntur, IN
    About Moveworks & 89 Solutions.Enterprise Agentic AI platform.IT, HR, Finance, Marketing etc).It offers an AI assistant that integrates with all applications in a company and helps employees to fin...Show moreLast updated: 30+ days ago
    • Promoted
    Webex CC

    Webex CC

    Servion Global SolutionsVijayawada, IN
    As a Senior Applications Developer, this position partners with customers to design and implement Cisco contact center applications and IVR call flows. Rather than focusing on infrastructure, this r...Show moreLast updated: 16 days ago
    • Promoted
    Specialist - Privacy Implementation

    Specialist - Privacy Implementation

    Baldor Technologies Private Limited (IDfy)Guntur, IN
    IDfy is Asia’s leading TrustStack, trusted by the best, with global expertise and enterprise-grade tech, we’re solving trust challenges, making compliance easy,fraud detection smarter, and onboardi...Show moreLast updated: 16 days ago
    • Promoted
    Microsoft Power App Lead

    Microsoft Power App Lead

    Persistent SystemsVijayawada, IN
    We are Looking for Lead having good experience in implementing and leading of Microsoft power platform as part of a service-oriented architecture for managing dynamic business process.Must be profi...Show moreLast updated: 16 days ago
    • Promoted
    Senior Technical Consultant

    Senior Technical Consultant

    R SystemsGuntur, IN
    Our product mindset and advanced engineering capabilities in.Customer Experience empower us to deliver innovative solutions to key players across the high-tech industry. This includes ISVs, SaaS, an...Show moreLast updated: 14 days ago