AI Automation Engineer | GenAI | Python | QA Automation | LLM Testing
Bengaluru (Onsite)
Full-time
Experience: 3–7 Years
We are hiring an AI Automation Engineer to work on next-generation AI-powered applications, intelligent automation systems, and Generative AI platforms.
This role is ideal for engineers with strong experience in automation testing + Python + AI/GenAI exposure, especially around LLM validation, AI workflow testing, and scalable automation frameworks.
Only candidates who can join immediately or within 15 days should apply.
What You'll Work On
- Build and maintain automation frameworks for web, API, and AI-driven applications
- Test and validate LLM/GenAI systems including:
- Prompt workflows
- RAG pipelines
- AI agents
- Response quality & hallucination handling
- Develop automation using Python, Selenium, Playwright, PyTest, etc.
- Perform API testing and backend validation
- Integrate automation into CI/CD pipelines
- Work closely with AI/ML and engineering teams to improve reliability and quality of AI systems
Required Skills
Strong Python programming
Selenium / Playwright / PyTest / Robot Framework
API Testing (Postman, REST APIs)
CI/CD tools (Jenkins, GitHub Actions, Azure DevOps)
Good understanding of QA automation concepts
Pytest
Preferred AI/GenAI Exposure
Experience with any of the following is a strong plus:
- Generative AI / LLMs
- Prompt engineering
- RAG pipelines
- LangChain / LangGraph
- OpenAI / Claude / Llama APIs
- AI model validation/testing
- Vector databases (FAISS, Pinecone, ChromaDB)
- AI-assisted testing frameworks
Good to Have
- AWS / Azure / GCP
- Docker / Kubernetes
- Performance testing (JMeter/k6)
- NLP or ML fundamentals
- Experience testing AI-based products
Who Should Apply
- Automation Engineers with AI exposure
- SDETs exploring GenAI
- AI QA Engineers
- GenAI Validation Engineers
- Python Automation Engineers interested in AI systems
Skills Required
Jenkins, Api Testing, Postman, Robot Framework, Rest Apis, Pytest, Azure Devops, Python, Selenium