AI Healthcare QA Engineer

Job Description

Role : Senior Test Automation Engineer

Experience Level : 3 to 6 Years

Work location : Bengaluru / Mumbai / Trivandrum

About the role : We are building revolutionary healthcare AI platforms integrating Digital Avatars, Voice AI, and Agentic AI into clinical workflows. As a TAE, you'll ensure quality, safety, and reliability of AI-powered healthcare applications while maintaining HIPAA compliance and clinical safety standards.

Role & Responsibilities :

• Design and implement UI automation frameworks for React-based healthcare applications
• Automate testing of digital avatar interactions and real-time visualizations
• Test ADA-compliant features and responsive design across devices
• Automate WebRTC audio / video streams and real-time communication testing
• Test software to ensure responsiveness and efficiency
• Test real-time database operations (Firestore, Cloud SQL)
• Validate session metadata, audit logs, and complex healthcare data structures
• Ensure HIPAA compliance, data encryption, and PII protection
• Perform SQL-based testing for healthcare data integration
• Execute complex healthcare workflow testing across multiple use cases
• Test multi-turn conversational flows and emergency scenario handling
• Validate edge cases, stress testing, and session recovery mechanisms
• Create comprehensive test scenarios for healthcare compliance
• Design and execute test plans for agent behavior across reasoning, tool usage, multi-turn flows, and goal completion
• Build and maintain automated testing frameworks for agent workflows using Python
• Test for hallucinations, prompt injection, bias, PII leakage, and response safety
• Test end-to-end integration between UI, microservices, and AI agents
• Self-starter – proactive and extremely detail oriented
• Validate GCP infrastructure, CI / CD pipelines, and deployment automation
• Implement Automated CI / CD processes using Jenkins tools
• Perform security testing and telephony platform integrations
• Test observability systems and cloud-based microservice environments
• Work with observability tools (e.G., LangSmith, Trulens, logging pipelines) to analyze agent execution
• Design test strategy and estimates for automation
• Technology focused, agnostic to tools, adaptable to change in technology
• Suggest quality fixes and improvements
• Mentor and guide team members. Collaborate with engineers to iterate on prompt design, tool chaining, and fallback logic
• Contribute to the development of agent test harnesses and benchmarking pipelines
• Validate message integrity and orchestration between avatar UI, voice services, context managers, and LLM endpoints using REST / gRPC / WebSocket automation
• Implement contract and schema validation for API integrations
• Test event-driven architectures using Kafka / MQTT and ensure reliable message delivery
• Ensure continuous integration and safe model rollout through MLOps-aware CI / CD testing
• Implement model version checks and regression suite hooks in deployment pipelines
• Work with Docker, Helm, and GitHub Actions for containerized deployments

Required Skills :

Core Testing & Automation :