This job offer is not available in your country.

Senior Quality Assurance Engineer - Automation Testing

Hirenotch Consulting ServicesBangalore

30+ days ago

Job description

Job Description :

We're looking for a highly independent AI QA Engineer who thrives at the intersection of traditional QA and cutting-edge AI evaluation. This role spans frontend automation, backend API testing, and the challenge of evaluating AI output for quality, correctness, and speed.

As part of our fast-moving team, you'll help shape the quality and reliability of how our AI interacts with :

Design and implement automated UI regression tests
Write and maintain robust API test suites to validate backend functionality with each release

Create and run AI evaluation tests to assess :

Quality and correctness of chatbot responses compared to ground truth and other products

TTFT, end-to-end-latency, and other timing performance

Build internal tools and datasets for testing and benchmarking

Collaborate closely with product, engineering, and AI teams to ensure end-to-end quality of AI product

Requirements :

Strong experience with frontend testing tools (e.g., Playwright, Cypress)

Proficient in backend / API testing (e.g., Postman, pytest, REST / GraphQL)

Familiarity with evaluating LLM / AI-generated content

Comfortable designing and analyzing test datasets for AI performance and functionality

Strong scripting skills (e.g., Python)

Highly autonomous with excellent problem-solving skills

ref : hirist.tech)

Create a job alert for this search

Quality Assurance Engineer Automation Testing • Bangalore