Talent.com
This job offer is not available in your country.
Generative AI Tester - Automation Testing

Generative AI Tester - Automation Testing

BB WorksHyderabad
5 days ago
Job description

Role Overview :

We are seeking a highly skilled Gen AI Tester to design and execute test strategies that ensure the quality, reliability, and accuracy of AI-driven applications, including chatbots, agents, and generative AI tools. This role demands strong expertise in both manual and automated testing, with a focus on validating AI outputs against business requirements and expected behavior.

Key Responsibilities :

Comprehensive Test Strategy Development :

  • Design, document, and execute detailed test plans and scenarios for AI chatbots, agents, and tools, ensuring rigorous validation of outputs against defined business rules and AI behavior.
  • Automated Test Scripting :
  • Develop, maintain, and enhance automated test scripts using Python, JavaScript, or Bash to streamline and scale testing across AI functionalities.

Defect Identification & Documentation :

  • Proactively identify, log, and track issues within AI models and applications. Provide clear and actionable bug reports with reproducible steps, expected vs. actual outcomes, and severity assessment.

    • Cross-functional Collaboration :

  • Partner with development, product, and data science teams to align on requirements, validate fixes, and provide feedback across the AI development lifecycle.

    • Continuous Improvement :

  • Stay updated on emerging tools, techniques, and trends in AI testing and automation. Recommend and implement process improvements to enhance product quality and testing efficiency.

    • Performance & Scalability Testing (Optional) :

  • Conduct load, stress, and scalability testing on AI models to validate system performance under diverse conditions and user loads.

    • Skills & Qualifications :

  • Proven AI Testing Experience : Hands-on experience in testing AI-driven applications, conversational AI platforms, or generative AI tools.
  • Proficient in Scripting & Automation : Strong coding skills in Python, JavaScript, or Bash for test automation.
  • Analytical Acumen : Ability to interpret complex technical / business requirements and design effective test scenarios.
  • Testing Expertise : Solid knowledge of manual and automated testing methodologies, including regression, integration, functional, and UAT.
  • Proactive & Independent : Self-starter with strong ownership, capable of independently identifying testing needs and driving solutions.
  • Communication Skills : Excellent verbal and written communication, with the ability to provide precise documentation and articulate findings to stakeholders.

    • (ref : hirist.tech)

    Create a job alert for this search

    Automation Testing • Hyderabad