No longer accepting applications
Prompt Engineer
Webknot Technologiesgurugram, uttar pradesh, in20 hours ago
Job description1–4 years of experience in QA, automation testing, AI validation, or NLP-based systems. Hands-on experience with LLM testing or evaluation (e.g., GPT, Claude, Gemini, or similar models). Strong understanding of software QA methodologies, testing types, and debugging processes. Proficiency in Java or another programming language for automation and testing workflows. Knowledge of GenAI concepts such as context handling, temperature tuning, and prompt behavior analysis. Excellent analytical, problem-solving, and documentation skills. Strong communication and collaboration skills for cross-functional teamwork. Experience with Agentic AI frameworks, LLMOps, or LLM evaluation tools such as DeepEval or LangChain. Familiarity with REST APIs, Postman, or cloud-based AI platforms (OpenAI, Anthropic, Vertex AI, etc.). Exposure to CI / CD pipelines, automated QA tools, or AI model monitoring systems.
Experience : 1–4 Years
Location : Bangalore (Onsite)
About the Role :
We are seeking an Agentic Automation QA Engineer with 1–4 years of experience to test, validate, and enhance Generative AI (GenAI) and Agentic automation workflows. The ideal candidate should possess a strong understanding of software testing principles, prompt evaluation, and LLM-based application behavior.
Candidates with Java programming experience will be given preference.
Key Responsibilities :
- Design, develop, and execute test cases for Agentic workflows and AI-driven automation processes.
- Validate AI agent behaviors, responses, and decision-making logic to ensure correctness, stability, and reliability.
- Evaluate and benchmark LLM outputs for accuracy, coherence, consistency, and alignment with defined objectives.
- Collaborate with developers, data scientists, and prompt engineers to identify and resolve issues across automation pipelines.
- Develop automated test frameworks or scripts for repeatable validation of GenAI features and Agentic components.
- Maintain detailed documentation of test plans, scenarios, and results for continuous improvement.
- Stay updated on LLM testing methodologies, Agentic frameworks, and emerging trends in AI automation QA.
Required Skills & Qualifications :
Good to Have
Create a job alert for this search
Engineer • gurugram, uttar pradesh, in
Related jobs
We are seeking a talented Prompt Engineer to join our team remotely.The ideal candidate will have 1-2 years of experience in prompt engineering or a related field, focusing on optimizing prompts fo...Show moreLast updated: 11 days ago 
- Promoted
Prompt Engineer
Innodata Inc.Delhi, IN Demonstrated experience programmatically using LLMs to automate data labeling, classification, localization and annotation tasks.
Strong expertise in Python for NLU, for data processing & transforma...Show moreLast updated: 6 days ago
- Promoted
AI Prompt Engineer
Robylon AInew delhi, delhi, in Write highly effective AI agents for some of the largest financial service firms and Consumer Brands.Craft high-impact prompts for AI agents to produce accurate responses.You will own end to end se...Show moreLast updated: 30+ days ago
- Promoted
Prompt Engineer
ConfidentialNoida, India D&D Healthcare is India's largest ventilator manufacturing company, established in 2018.Now the company with its new vertical Fiberise Fit Pvt Ltd is launching a nutraceutical supplement focused at...Show moreLast updated: 10 days ago
- Promoted
Senior Prompt Engineer (0nsite-Noida)(5 Days WFO)
ConfidentialNoida, India INR 4000000-6000000 / year (based on experience).Full Time Permanent position(Payroll and Compliance to be managed by : Threat Modeler Software Inc).
Note : This is a requirement for one of Uplers' cl...Show moreLast updated: 10 days ago
- Promoted
Engineer I To Lead Engineer - Bid / Proposal Management
ConfidentialPune, Bengaluru / Bangalore, Gurgaon / Gurugram Work as a proposal lead to coordinate with technical staff and develop RFP-compliant, competitive, and quality proposals and statements of qualification.
Understands the AtkinsRalis brand initiative...Show moreLast updated: 30+ days ago
- Promoted
Principal Performance Engineer
ANSR Summit ConsultingGurgaon, India Responsible for product releases that meet the performance release criteria for successful deployment to production.Demonstrate an advanced ability to analyze intricate issues and derive effective ...Show moreLast updated: 30+ days ago
- Promoted
Gtm Engineer
nRevNoida, Republic Of India, IN AI-powered Revenue Orchestration platform that lets GTM teams spin up custom agents to automate, enrich, and accelerate every step of the enterprise sales cycle.
We have early revenue, rabidly enthu...Show moreLast updated: 21 days ago
- Promoted
Principal Engineer
ConfidentialGurugram, Gurgaon / Gurugram, India We are seeking a talented individual to join our Technology team at Mercer.This role will be based in Gurugram.This is a hybrid role that has a requirement of working at least three days a week in ...Show moreLast updated: 30+ days ago
- Promoted
Prompt Engineer- work from home- 1 to 2 years- Upto 10 Lakhs PA
ConfidentialPune, Delhi NCR, NoidaRemote
- Promoted
Principal Engineer - Applications Development
ConfidentialGurgaon / Gurugram, Noida Participate in high and low level design activities.Designing, developing delivering end to end software solutions.Ensure reusability, security, performance and standard industry coding practices a...Show moreLast updated: 30+ days ago
- Promoted
iSeries Engineer
Insight GlobalDelhi, IN Position : iSeries Developer / Software Engineer.Company : Insight Global Customer.Max CTC Available : 30LPA fixed Pay.MUST be able to join in 30 days or less for critical go live.Minimum of 3 years of ...Show moreLast updated: 7 days ago
- Promoted
Software Engineer – AI (Prompt Engineering & Full Stack)
Bulwark Healthfaridabad, haryana, in Software Engineer – AI (Prompt Engineering & Full Stack).Location : Remote / United States / India.Product Stage : (Stealth Mode) AI Product Platform for Healthcare.
We’re a growing healthtech startu...Show moreLast updated: 1 day ago
- Promoted
Principal Engineer, C9
ConfidentialGurugram, Gurgaon / Gurugram, India Join our digital revolution in NatWest Digital X.In everything we do, we work to one aim.To make digital experiences which are effortless and secure.
So we organise ourselves around three principles...Show moreLast updated: 10 days ago
- Promoted
Bid / Proposal Engineer
ConfidentialNoida We are looking for a proactive and detail-oriented Bid / Proposal Engineer to join our Sales team.The selected candidate will be responsible for preparing techno-commercial offers, coordinating with ...Show moreLast updated: 30+ days ago
- Promoted
Prompt Engineer
Zetheta Algorithms Private LimitedDelhi, Delhi, India About the Company ZeTheta Algorithms Private Limited is a FinTech start-up which has been recently set up and is developing innovative AI tools.
About the Role We are seeking a talented and motivate...Show moreLast updated: 30+ days ago
- Promoted
Deployment Engineer
AvocaDelhi, IN Build, launch & optimize AI agents that power the next generation of home-service customer experiences.Avoca is the all-in-one AI lead-conversion platform.
Our technology boosts booking rates, slash...Show moreLast updated: 30+ days ago
- Promoted
Principal Engineer(Flutter)- Fintech Startup
Taglynkdelhi, delhi, in Partner with product and design teams to rethink the future of Trading and Investing.Own the architecture and development of critical features for our Flutter-based apps on iOS, Android and the Web...Show moreLast updated: 7 days ago
- Promoted
Marketing Engineer
ConfidentialNoida To develop new business with existing / new customers.Ability to understand the customers' business, their objectives & providing solutions.
Communicates with customers to determine their needs and ...Show moreLast updated: 30+ days ago