Job Description
Role :
Senior Test Automation Engineer
Experience Level : 3 to 6 Years
Work location :
Bengaluru / Mumbai / Trivandrum
About the role :
We are building revolutionary healthcare AI platforms integrating Digital Avatars, Voice AI, and Agentic AI into clinical workflows. As a TAE, you'll ensure quality, safety, and reliability of AI-powered healthcare applications while maintaining HIPAA compliance and clinical safety standards.
Role & Responsibilities :
Design and implement UI automation frameworks for React-based healthcare applications
Automate testing of digital avatar interactions and real-time visualizations
Test ADA-compliant features and responsive design across devices
Automate WebRTC audio / video streams and real-time communication testing
Test software to ensure responsiveness and efficiency
Test real-time database operations (Firestore, Cloud SQL)
Validate session metadata, audit logs, and complex healthcare data structures
Ensure HIPAA compliance, data encryption, and PII protection
Perform SQL-based testing for healthcare data integration
Execute complex healthcare workflow testing across multiple use cases
Test multi-turn conversational flows and emergency scenario handling
Validate edge cases, stress testing, and session recovery mechanisms
Create comprehensive test scenarios for healthcare compliance
Design and execute test plans for agent behavior across reasoning, tool usage, multi-turn flows, and goal completion
Build and maintain automated testing frameworks for agent workflows using Python
Test for hallucinations, prompt injection, bias, PII leakage, and response safety
Test end-to-end integration between UI, microservices, and AI agents
Self-starter – proactive and extremely detail oriented
Validate GCP infrastructure, CI / CD pipelines, and deployment automation
Implement Automated CI / CD processes using Jenkins tools
Perform security testing and telephony platform integrations
Test observability systems and cloud-based microservice environments
Work with observability tools (e.g., LangSmith, Trulens, logging pipelines) to analyze agent execution
Design test strategy and estimates for automation
Technology focused, agnostic to tools, adaptable to change in technology
Suggest quality fixes and improvements
Mentor and guide team members. Collaborate with engineers to iterate on prompt design, tool chaining, and fallback logic
Contribute to the development of agent test harnesses and benchmarking pipelines
Validate message integrity and orchestration between avatar UI, voice services, context managers, and LLM endpoints using REST / gRPC / WebSocket automation
Implement contract and schema validation for API integrations
Test event-driven architectures using Kafka / MQTT and ensure reliable message delivery
Ensure continuous integration and safe model rollout through MLOps-aware CI / CD testing
Implement model version checks and regression suite hooks in deployment pipelines
Work with Docker, Helm, and GitHub Actions for containerized deployments
Required Skills :
Core Testing & Automation :
3+ years QA automation experience with Selenium WebDriver expertise
Java / Python programming for automation frameworks
API Testing proficiency (RestAssured, Postman, REST / GraphQL APIs)
Event-driven automation (REST / gRPC / WebSocket, Kafka / MQTT testing)
Contract & schema validation expertise
Async workflow simulation and event bus testing (Kafka, NATS)
API contract testing tools (Karate, Swagger mocks, pact testing)
Senior Test Engineer • Nashik, Maharashtra, India