Job Description
Role : Senior Test Automation Engineer
Experience Level : 3 to 6 Years
Work location : Bengaluru / Mumbai / Trivandrum
About the role : We are building revolutionary healthcare AI platforms integrating Digital Avatars, Voice AI, and Agentic AI into clinical workflows. As a TAE, you'll ensure quality, safety, and reliability of AI-powered healthcare applications while maintaining HIPAA compliance and clinical safety standards.
Role & Responsibilities :
- Design and implement UI automation frameworks for React-based healthcare applications
- Automate testing of digital avatar interactions and real-time visualizations
- Test ADA-compliant features and responsive design across devices
- Automate WebRTC audio / video streams and real-time communication testing
- Test software to ensure responsiveness and efficiency
- Test real-time database operations (Firestore, Cloud SQL)
- Validate session metadata, audit logs, and complex healthcare data structures
- Ensure HIPAA compliance, data encryption, and PII protection
- Perform SQL-based testing for healthcare data integration
- Execute complex healthcare workflow testing across multiple use cases
- Test multi-turn conversational flows and emergency scenario handling
- Validate edge cases, stress testing, and session recovery mechanisms
- Create comprehensive test scenarios for healthcare compliance
- Design and execute test plans for agent behavior across reasoning, tool usage, multi-turn flows, and goal completion
- Build and maintain automated testing frameworks for agent workflows using Python
- Test for hallucinations, prompt injection, bias, PII leakage, and response safety
- Test end-to-end integration between UI, microservices, and AI agents
- Self-starter – proactive and extremely detail oriented
- Validate GCP infrastructure, CI / CD pipelines, and deployment automation
- Implement Automated CI / CD processes using Jenkins tools
- Perform security testing and telephony platform integrations
- Test observability systems and cloud-based microservice environments
- Work with observability tools (e.g., LangSmith, Trulens, logging pipelines) to analyze agent execution
- Design test strategy and estimates for automation
- Technology focused, agnostic to tools, adaptable to change in technology
- Suggest quality fixes and improvements
- Mentor and guide team members. Collaborate with engineers to iterate on prompt design, tool chaining, and fallback logic
- Contribute to the development of agent test harnesses and benchmarking pipelines
- Validate message integrity and orchestration between avatar UI, voice services, context managers, and LLM endpoints using REST / gRPC / WebSocket automation
- Implement contract and schema validation for API integrations
- Test event-driven architectures using Kafka / MQTT and ensure reliable message delivery
- Ensure continuous integration and safe model rollout through MLOps-aware CI / CD testing
- Implement model version checks and regression suite hooks in deployment pipelines
- Work with Docker, Helm, and GitHub Actions for containerized deployments
Required Skills :
Core Testing & Automation :
3+ years QA automation experience with Selenium WebDriver expertiseJava / Python programming for automation frameworksAPI Testing proficiency (RestAssured, Postman, REST / GraphQL APIs)Event-driven automation (REST / gRPC / WebSocket, Kafka / MQTT testing)Contract & schema validation expertiseAsync workflow simulation and event bus testing (Kafka, NATS)API contract testing tools (Karate, Swagger mocks, pact testing)