Job Description :
We're looking for a highly independent AI QA Engineer who thrives at the intersection of traditional QA and cutting-edge AI evaluation. This role spans frontend automation, backend API testing, and the challenge of evaluating AI output for quality, correctness, and speed.
As part of our fast-moving team, you'll help shape the quality and reliability of how our AI interacts with :
- Design and implement automated UI regression tests
- Write and maintain robust API test suites to validate backend functionality with each release
Create and run AI evaluation tests to assess :
Quality and correctness of chatbot responses compared to ground truth and other productsTTFT, end-to-end-latency, and other timing performanceBuild internal tools and datasets for testing and benchmarkingCollaborate closely with product, engineering, and AI teams to ensure end-to-end quality of AI productRequirements :
Strong experience with frontend testing tools (e.g., Playwright, Cypress)Proficient in backend / API testing (e.g., Postman, pytest, REST / GraphQL)Familiarity with evaluating LLM / AI-generated contentComfortable designing and analyzing test datasets for AI performance and functionalityStrong scripting skills (e.g., Python)Highly autonomous with excellent problem-solving skillsref : hirist.tech)