Senior Test Engineer

Job Description

Role : Senior Test Automation Engineer

Experience Level : 3 to 6 Years

Work location : Bengaluru / Mumbai / Trivandrum

About the role : We are building revolutionary healthcare AI platforms integrating Digital Avatars, Voice AI, and Agentic AI into clinical workflows. As a TAE, you'll ensure quality, safety, and reliability of AI-powered healthcare applications while maintaining HIPAA compliance and clinical safety standards.

Role & Responsibilities :

Design and implement UI automation frameworks for React-based healthcare applications

Automate testing of digital avatar interactions and real-time visualizations

Test ADA-compliant features and responsive design across devices

Automate WebRTC audio / video streams and real-time communication testing

Test software to ensure responsiveness and efficiency

Test real-time database operations (Firestore, Cloud SQL)

Validate session metadata, audit logs, and complex healthcare data structures

Ensure HIPAA compliance, data encryption, and PII protection

Perform SQL-based testing for healthcare data integration

Execute complex healthcare workflow testing across multiple use cases

Test multi-turn conversational flows and emergency scenario handling

Validate edge cases, stress testing, and session recovery mechanisms

Create comprehensive test scenarios for healthcare compliance

Design and execute test plans for agent behavior across reasoning, tool usage, multi-turn flows, and goal completion

Build and maintain automated testing frameworks for agent workflows using Python

Test for hallucinations, prompt injection, bias, PII leakage, and response safety

Test end-to-end integration between UI, microservices, and AI agents

Self-starter – proactive and extremely detail oriented

Validate GCP infrastructure, CI / CD pipelines, and deployment automation

Implement Automated CI / CD processes using Jenkins tools

Perform security testing and telephony platform integrations

Test observability systems and cloud-based microservice environments

Work with observability tools (e.g., LangSmith, Trulens, logging pipelines) to analyze agent execution

Design test strategy and estimates for automation

Technology focused, agnostic to tools, adaptable to change in technology

Suggest quality fixes and improvements

Mentor and guide team members. Collaborate with engineers to iterate on prompt design, tool chaining, and fallback logic

Contribute to the development of agent test harnesses and benchmarking pipelines

Validate message integrity and orchestration between avatar UI, voice services, context managers, and LLM endpoints using REST / gRPC / WebSocket automation

Implement contract and schema validation for API integrations

Test event-driven architectures using Kafka / MQTT and ensure reliable message delivery

Ensure continuous integration and safe model rollout through MLOps-aware CI / CD testing

Implement model version checks and regression suite hooks in deployment pipelines

Work with Docker, Helm, and GitHub Actions for containerized deployments

Required Skills :

Core Testing & Automation :

3+ years QA automation experience with Selenium WebDriver expertise

Java / Python programming for automation frameworks

API Testing proficiency (RestAssured, Postman, REST / GraphQL APIs)

Event-driven automation (REST / gRPC / WebSocket, Kafka / MQTT testing)

Contract & schema validation expertise

Async workflow simulation and event bus testing (Kafka, NATS)

API contract testing tools (Karate, Swagger mocks, pact testing)