Prompt Engineer
Webknot Technologiessecunderabad, telangana, in7 hours ago
Job description1–4 years of experience in QA, automation testing, AI validation, or NLP-based systems. Hands-on experience with LLM testing or evaluation (e.g., GPT, Claude, Gemini, or similar models). Strong understanding of software QA methodologies, testing types, and debugging processes. Proficiency in Java or another programming language for automation and testing workflows. Knowledge of GenAI concepts such as context handling, temperature tuning, and prompt behavior analysis. Excellent analytical, problem-solving, and documentation skills. Strong communication and collaboration skills for cross-functional teamwork. Experience with Agentic AI frameworks, LLMOps, or LLM evaluation tools such as DeepEval or LangChain. Familiarity with REST APIs, Postman, or cloud-based AI platforms (OpenAI, Anthropic, Vertex AI, etc.). Exposure to CI / CD pipelines, automated QA tools, or AI model monitoring systems.
Experience : 1–4 Years
Location : Bangalore (Onsite)
About the Role :
We are seeking an Agentic Automation QA Engineer with 1–4 years of experience to test, validate, and enhance Generative AI (GenAI) and Agentic automation workflows. The ideal candidate should possess a strong understanding of software testing principles, prompt evaluation, and LLM-based application behavior.
Candidates with Java programming experience will be given preference.
Key Responsibilities :
- Design, develop, and execute test cases for Agentic workflows and AI-driven automation processes.
- Validate AI agent behaviors, responses, and decision-making logic to ensure correctness, stability, and reliability.
- Evaluate and benchmark LLM outputs for accuracy, coherence, consistency, and alignment with defined objectives.
- Collaborate with developers, data scientists, and prompt engineers to identify and resolve issues across automation pipelines.
- Develop automated test frameworks or scripts for repeatable validation of GenAI features and Agentic components.
- Maintain detailed documentation of test plans, scenarios, and results for continuous improvement.
- Stay updated on LLM testing methodologies, Agentic frameworks, and emerging trends in AI automation QA.
Required Skills & Qualifications :
Good to Have
Create a job alert for this search
Engineer • secunderabad, telangana, in
Related jobs
A global technology company specializing in digital transformation services for the telecommunications, media, and technology (TMT) industries.
It focuses on AI, automation, cloud, and IoT to drive ...Show moreLast updated: 30+ days ago
- Promoted
- New!
Prompt Engineer
Meraki Labssecunderabad, telangana, in Meraki Labs is one of India's first startup studios, backed by Mukesh Bansal (founder Myntra, Curefit, Nurix).We co-build companies and scale AI-first moonshot startups.
Our current focus is a groun...Show moreLast updated: 8 hours ago
- Promoted
AI Prompt Engineer
Robylon AIsecunderabad, telangana, in Write highly effective AI agents for some of the largest financial service firms and Consumer Brands.Craft high-impact prompts for AI agents to produce accurate responses.You will own end to end se...Show moreLast updated: 30+ days ago
- Promoted
- New!
Firmware Engineer
Alp Consulting Ltd.secunderabad, telangana, in BE / BTech / ME / Mtech / MSc in Computer Science / VLSI / Embedded / Electronics (& Telecommunication) / Instrumentation & Control from reputed institute.
Exposure to CAN / CAN(FD) and higher level protocol...Show moreLast updated: 7 hours ago
- Promoted
Prompt Engineer
Zetheta Algorithms Private LimitedHyderabad, IN ZeTheta Algorithms Private Limited is a FinTech start-up which has been recently set up and is developing innovative AI tools.
We are seeking a talented and motivated student intern for Portfolio Ma...Show moreLast updated: 30+ days ago
- Promoted
Principal Engineer
ConfidentialHyderabad / Secunderabad, Telangana, India Our purpose is to help a billion people find the right work! Phenom is an AI-Powered talent experience platform that is redefining the HR tech space.
We have grown into a global organization with of...Show moreLast updated: 30+ days ago
- Promoted
- New!
Firmware Engineer
TekPillar®secunderabad, telangana, in Collaborate with the hardware team to support new board designs and HW modifications.Linux OS internals, device drivers, and package compilation.
Coordinate with cross-domain teams for.Ensure robust...Show moreLast updated: 7 hours ago
- Promoted
- New!
Prompt Engineer
VMockhyderabad, telangana, in Collaborate closely with product and engineering teams to optimise AI agent performance.Conduct context tuning to enhance AI output quality for various career-related applications.Analyse and refin...Show moreLast updated: 7 hours ago
GenAI - Prompt Engineer
Saaki Argus & Averil ConsultingHyderabad, Telangana, IndiaQuick Apply
- Promoted
Prompt Engineer
Innodata Inc.Hyderabad, IN Demonstrated experience programmatically using LLMs to automate data labeling, classification, localization and annotation tasks.
Strong expertise in Python for NLU, for data processing & transforma...Show moreLast updated: 6 days ago
- Promoted
Prompt Engineer - LLM / NLP Applications
Syntec Systems India Pvt LtdHyderabad About the Role : We are seeking a skilled and highly motivated Prompt Engineer to join our team in Hyderabad.In this role, you will play a key part in designing, testin...Show moreLast updated: 30+ days ago
- Promoted
Proposal Engineer
ConfidentialHyderabad / Secunderabad, Telangana, India Urgent hiring for Proposal Engineer / / .Ctc- upto 7 lpa (Depends on interview).Working days- 5 days (9 : 30am- 5 : 30 pm.
The Technical Proposal Engineer for Condition Monitoring of Electrical Assets wil...Show moreLast updated: 10 days ago
- Promoted
Automation Estimation & Proposal Engineer
Q4S Digital Transformationhyderabad, India Q4S is a next-generation digital transformation platform designed to empower industries with automation, intelligence, and efficiency.
We bring together SCADA, IoT, cloud, analytics, and AI to creat...Show moreLast updated: 6 days ago
- Promoted
Software Engineer – Ai (Prompt Engineering & Full Stack)
Bulwark HealthHyderabad, Republic Of India, IN Software Engineer – AI (Prompt Engineering & Full Stack).Location : Remote / United States / India.Product Stage : (Stealth Mode) AI Product Platform for Healthcare.
We’re a growing healthtech startup...Show moreLast updated: 1 day ago
- Promoted
Principal Technical Engineer(Configurations)
Qinecsa SolutionsHyderabad, IN We are seeking a Principal Technical Engineer to develop and deploy client configurations for our flagship Qinecsa Vigilance Workbench signal detection platform.
The ideal candidate will be dynamic ...Show moreLast updated: 27 days ago
- Promoted
Generative AI Engineer
LTIMindtreeHyderabad, India We're Hiring : Data Scientist / GenAI Engineer (5–12 Years Experience).Location : Pan India | Employment Type : Full-Time | Hybrid options available.
Are you passionate about solving real-world probl...Show moreLast updated: 27 days ago
- Promoted
Software Engineer – AI (Prompt Engineering & Full Stack)
Bulwark Healthsecunderabad, telangana, in Software Engineer – AI (Prompt Engineering & Full Stack).Location : Remote / United States / India.Product Stage : (Stealth Mode) AI Product Platform for Healthcare.
We’re a growing healthtech startu...Show moreLast updated: 1 day ago
- Promoted
Ai Prompt Engineer
Robylon AIHyderabad, Republic Of India, IN Write highly effective AI agents for some of the largest financial service firms and Consumer Brands.Craft high-impact prompts for AI agents to produce accurate responses.You will own end to end se...Show moreLast updated: 1 day ago
- Promoted
AS400 Production Support Engineer
hirezy.aiHyderabad What You Will Do : - Provide end-to-end production support for AS400 applications.Monitor, troubleshoot, and resolve incidents ensuring minimal downtime.Investigate r...Show moreLast updated: 30+ days ago