Prompt Engineer
Webknot Technologiesnarela, delhi, in8 hours ago
Job description1–4 years of experience in QA, automation testing, AI validation, or NLP-based systems. Hands-on experience with LLM testing or evaluation (e.g., GPT, Claude, Gemini, or similar models). Strong understanding of software QA methodologies, testing types, and debugging processes. Proficiency in Java or another programming language for automation and testing workflows. Knowledge of GenAI concepts such as context handling, temperature tuning, and prompt behavior analysis. Excellent analytical, problem-solving, and documentation skills. Strong communication and collaboration skills for cross-functional teamwork. Experience with Agentic AI frameworks, LLMOps, or LLM evaluation tools such as DeepEval or LangChain. Familiarity with REST APIs, Postman, or cloud-based AI platforms (OpenAI, Anthropic, Vertex AI, etc.). Exposure to CI / CD pipelines, automated QA tools, or AI model monitoring systems.
Experience : 1–4 Years
Location : Bangalore (Onsite)
About the Role :
We are seeking an Agentic Automation QA Engineer with 1–4 years of experience to test, validate, and enhance Generative AI (GenAI) and Agentic automation workflows. The ideal candidate should possess a strong understanding of software testing principles, prompt evaluation, and LLM-based application behavior.
Candidates with Java programming experience will be given preference.
Key Responsibilities :
- Design, develop, and execute test cases for Agentic workflows and AI-driven automation processes.
- Validate AI agent behaviors, responses, and decision-making logic to ensure correctness, stability, and reliability.
- Evaluate and benchmark LLM outputs for accuracy, coherence, consistency, and alignment with defined objectives.
- Collaborate with developers, data scientists, and prompt engineers to identify and resolve issues across automation pipelines.
- Develop automated test frameworks or scripts for repeatable validation of GenAI features and Agentic components.
- Maintain detailed documentation of test plans, scenarios, and results for continuous improvement.
- Stay updated on LLM testing methodologies, Agentic frameworks, and emerging trends in AI automation QA.
Required Skills & Qualifications :
Good to Have
Create a job alert for this search
Engineer • narela, delhi, in
Related jobs
- Promoted
Prompt Engineer
Innodata Inc.Delhi, IN Demonstrated experience programmatically using LLMs to automate data labeling, classification, localization and annotation tasks.
Strong expertise in Python for NLU, for data processing & transforma...Show moreLast updated: 6 days ago
- Promoted
- New!
Prompt Engineer
Meraki Labspanipat, haryana, in Meraki Labs is one of India's first startup studios, backed by Mukesh Bansal (founder Myntra, Curefit, Nurix).We co-build companies and scale AI-first moonshot startups.
Our current focus is a groun...Show moreLast updated: 8 hours ago
- Promoted
AI Prompt Engineer
Robylon AIpanipat, haryana, in Write highly effective AI agents for some of the largest financial service firms and Consumer Brands.Craft high-impact prompts for AI agents to produce accurate responses.You will own end to end se...Show moreLast updated: 30+ days ago
- Promoted
Proposal Engineer
Valiant EnterprisesDelhi, India We are looking for a dedicated and technically strong Proposal Engineer to join our team for Water Treatment, Sewage Treatment (STP), Effluent Treatment (ETP), and Infrastructure Projects.The ideal...Show moreLast updated: 19 days ago
- Promoted
Proposal Engineer
Agile Technology Solutions - Your Technology PartnerDelhi, India Proposal Creation • Study customer enquiries and tender documents.Prepare techno-commercial proposals for ESP and Bag Filters.
Submit bids for government tenders.Attend technical evaluation meetings...Show moreLast updated: 6 days ago
- Promoted
Prompt Engineer
Olive Green ConsultingDelhi, India Prompt Engineering, Conversational Design, LLMs (Large Language Models), NLP, UX Writing Shift : .Bangalore (Full-time, On-site) ️.
English (Required); Tamil, Telugu, Hindi & other regional languages ...Show moreLast updated: 2 days ago
- Promoted
Principal Engineer(Flutter)- Fintech Startup
TaglynkDelhi, India Roles & Responsibilities : Partner with product and design teams to rethink the future of Trading and Investing.Own the architecture and development of critical features for our Flutter-based apps o...Show moreLast updated: 5 days ago
- Promoted
Principal Engineer
Wenger & WatsonDelhi, India Principal Engineer — Marketing & CRM Location : .About the Role : We’re seeking a Principal Engineer to drive the evolution of our cloud-native, SaaS-based marketing and CRM platform serving banks and...Show moreLast updated: 15 days ago
- Promoted
Ai Prompt Engineer
Robylon AIDelhi, Republic Of India, IN Write highly effective AI agents for some of the largest financial service firms and Consumer Brands.Craft high-impact prompts for AI agents to produce accurate responses.You will own end to end se...Show moreLast updated: 1 day ago
- Promoted
- New!
Prompt Engineer
VMockdelhi, delhi, in Collaborate closely with product and engineering teams to optimise AI agent performance.Conduct context tuning to enhance AI output quality for various career-related applications.Analyse and refin...Show moreLast updated: 8 hours ago
- Promoted
Software Engineer – AI (Prompt Engineering & Full Stack)
Bulwark Healthpanipat, haryana, in Software Engineer – AI (Prompt Engineering & Full Stack).Location : Remote / United States / India.Product Stage : (Stealth Mode) AI Product Platform for Healthcare.
We’re a growing healthtech startu...Show moreLast updated: 1 day ago
- Promoted
Prompt Engineer
ConfidentialNoida, India D&D Healthcare is India's largest ventilator manufacturing company, established in 2018.Now the company with its new vertical Fiberise Fit Pvt Ltd is launching a nutraceutical supplement focused at...Show moreLast updated: 10 days ago
- Promoted
Senior Prompt Engineer (0nsite-Noida)(5 Days WFO)
ConfidentialNoida, India INR 4000000-6000000 / year (based on experience).Full Time Permanent position(Payroll and Compliance to be managed by : Threat Modeler Software Inc).
Note : This is a requirement for one of Uplers' cl...Show moreLast updated: 10 days ago
- Promoted
- New!
Prompt Engineer
Webknot Technologiesnew delhi, delhi, in We are seeking an Agentic Automation QA Engineer with 1–4 years of experience to test, validate, and enhance Generative AI (GenAI) and Agentic automation workflows.
The ideal candidate should posses...Show moreLast updated: 8 hours ago
- Promoted
- New!
Prompt Engineer-JIS119036 (Only 24h Left)
MM Management ConsultantDelhi, Delhi, India Job Details : Job Title : Prompt Engineer Experience : 6 to 10 Years Type : Remote | Full-time Employment Notice Period : Immediate to 30 Days Role Overview : We are seeking skilled professionals wit...Show moreLast updated: 21 hours ago
- Promoted
Proposal Engineer
ConfidentialDelhi, India How will you CONTRIBUTE and GROW The Proposal Engineer is responsible for developing competitive offers which fulfill customer requirements.
These offers shall define technical & commercial terms in...Show moreLast updated: 5 days ago
- Promoted
iSeries Engineer
Insight GlobalDelhi, IN Position : iSeries Developer / Software Engineer.Company : Insight Global Customer.Max CTC Available : 30LPA fixed Pay.MUST be able to join in 30 days or less for critical go live.Minimum of 3 years of ...Show moreLast updated: 6 days ago
- Promoted
Prompt Engineer
Zetheta Algorithms Private LimitedDelhi, IN ZeTheta Algorithms Private Limited is a FinTech start-up which has been recently set up and is developing innovative AI tools.
We are seeking a talented and motivated student intern for Portfolio Ma...Show moreLast updated: 30+ days ago