Prompt Engineer
Webknot TechnologiesNadiād, Republic Of India, IN2 hours ago
Job description1–4 years of experience in QA, automation testing, AI validation, or NLP-based systems. Hands-on experience with LLM testing or evaluation (e.G., GPT, Claude, Gemini, or similar models). Strong understanding of software QA methodologies, testing types, and debugging processes. Proficiency in Java or another programming language for automation and testing workflows. Knowledge of GenAI concepts such as context handling, temperature tuning, and prompt behavior analysis. Excellent analytical, problem-solving, and documentation skills. Strong communication and collaboration skills for cross-functional teamwork. Experience with Agentic AI frameworks, LLMOps, or LLM evaluation tools such as DeepEval or LangChain. Familiarity with REST APIs, Postman, or cloud-based AI platforms (OpenAI, Anthropic, Vertex AI, etc.). Exposure to CI / CD pipelines, automated QA tools, or AI model monitoring systems.
Experience : 1–4 Years
Location : Bangalore (Onsite)
About the Role :
We are seeking an Agentic Automation QA Engineer with 1–4 years of experience to test, validate, and enhance Generative AI (GenAI) and Agentic automation workflows. The ideal candidate should possess a strong understanding of software testing principles, prompt evaluation, and LLM-based application behavior.
Candidates with Java programming experience will be given preference.
Key Responsibilities :
- Design, develop, and execute test cases for Agentic workflows and AI-driven automation processes.
- Validate AI agent behaviors, responses, and decision-making logic to ensure correctness, stability, and reliability.
- Evaluate and benchmark LLM outputs for accuracy, coherence, consistency, and alignment with defined objectives.
- Collaborate with developers, data scientists, and prompt engineers to identify and resolve issues across automation pipelines.
- Develop automated test frameworks or scripts for repeatable validation of GenAI features and Agentic components.
- Maintain detailed documentation of test plans, scenarios, and results for continuous improvement.
- Stay updated on LLM testing methodologies, Agentic frameworks, and emerging trends in AI automation QA.
Required Skills & Qualifications :
Good to Have
Create a job alert for this search
Engineer • Nadiād, Republic Of India, IN
Related jobs
- Promoted
Prompt Engineer
Innodata Inc.Vadodara, IN Demonstrated experience programmatically using LLMs to automate data labeling, classification, localization and annotation tasks.
Strong expertise in Python for NLU, for data processing & transforma...Show moreLast updated: 6 days ago
- Promoted
Ai Prompt Engineer
Robylon AIAnand, Republic Of India, IN Write highly effective AI agents for some of the largest financial service firms and Consumer Brands.Craft high-impact prompts for AI agents to produce accurate responses.You will own end to end se...Show moreLast updated: 1 day ago
- Promoted
Automation Estimation & Proposal Engineer
Q4S Digital Transformationvadodara, India Q4S is a next-generation digital transformation platform designed to empower industries with automation, intelligence, and efficiency.
We bring together SCADA, IoT, cloud, analytics, and AI to creat...Show moreLast updated: 6 days ago
- Promoted
Software Engineer – Ai (Prompt Engineering & Full Stack)
Bulwark HealthAhmedabad, Republic Of India, IN Software Engineer – AI (Prompt Engineering & Full Stack).Location : Remote / United States / India.Product Stage : (Stealth Mode) AI Product Platform for Healthcare.
We’re a growing healthtech startup...Show moreLast updated: 1 day ago
- Promoted
- New!
Prompt Engineer
Meraki Labsnadiad, gujarat, in Meraki Labs is one of India's first startup studios, backed by Mukesh Bansal (founder Myntra, Curefit, Nurix).We co-build companies and scale AI-first moonshot startups.
Our current focus is a groun...Show moreLast updated: 13 hours ago
- Promoted
AI Prompt Engineer
Robylon AIanand, gujarat, in Write highly effective AI agents for some of the largest financial service firms and Consumer Brands.Craft high-impact prompts for AI agents to produce accurate responses.You will own end to end se...Show moreLast updated: 30+ days ago
- Promoted
Prompt Engineer
ConfidentialAhmedabad, India Design, evaluate, and refine prompts to guide LLMs in producing accurate, relevant, and high-quality outputs for real-world applications such as voice bots, chatbots, and automation flows.Minimum o...Show moreLast updated: 10 days ago
- Promoted
EMBEDDED FIRMWARE ENGINEER - ENGINEER
ConfidentialAhmedabad, India We believe in sustainable growth.Learn about the guiding forces and our future prospects that motivate us to advance in our niche.
Locate our corporate office and research centers that are widesprea...Show moreLast updated: 10 days ago
- Promoted
Frappe Engineer
ConfidentialAhmedabad, India At Momentum91, we craft scalable, high-performance software solutions that help businesses.Our proven expertise spans across SaaS product.
ERP systems, and custom IT services for mid-market to enter...Show moreLast updated: 10 days ago
- Promoted
Prompt Engineer
Zetheta Algorithms Private Limitedahmedabad, gujarat, in ZeTheta Algorithms Private Limited is a FinTech start-up which has been recently set up and is developing innovative AI tools.
We are seeking a talented and motivated student intern for Portfolio Ma...Show moreLast updated: 30+ days ago
- Promoted
iSeries Engineer
Insight GlobalAhmedabad, IN Position : iSeries Developer / Software Engineer.Company : Insight Global Customer.Max CTC Available : 30LPA fixed Pay.MUST be able to join in 30 days or less for critical go live.Minimum of 3 years of ...Show moreLast updated: 7 days ago
- Promoted
Principal Technical Engineer(Configurations)
Qinecsa SolutionsNadiad, IN We are seeking a Principal Technical Engineer to develop and deploy client configurations for our flagship Qinecsa Vigilance Workbench signal detection platform.
The ideal candidate will be dynamic ...Show moreLast updated: 27 days ago
- Promoted
Engineer - MBOP
ConfidentialVadodara, India Allotted work to be perform in define schedules and budgeted manhours.Active participation in basic design and detail design activities.
Standardization and methodology aspects for mechanical engine...Show moreLast updated: 10 days ago
- Promoted
- New!
Performance Engineer (Devops)
HCLSoftwareNadiād, Republic Of India, IN Greetings from “HCL Software” Is a Product Development Division of HCL Tech!!.HCL Software” : - Is a Product Development Division of HCL Tech : That operates its primary Software Business.At HCL Soft...Show moreLast updated: 2 hours ago
- Promoted
Propulsion Engineer- III
ConfidentialAhmedabad, India Catalyx is developing next-generation entry systems for space.As a Level - III Propulsion Engineer, you will lead the design and development of our propulsion architecture, including tanks, valves,...Show moreLast updated: 10 days ago
- Promoted
Deployment Engineer
AvocaAhmedabad, IN Build, launch & optimize AI agents that power the next generation of home-service customer experiences.Avoca is the all-in-one AI lead-conversion platform.
Our technology boosts booking rates, slash...Show moreLast updated: 30+ days ago
- Promoted
Software Engineer – AI (Prompt Engineering & Full Stack)
Bulwark Healthnadiad, gujarat, in Software Engineer – AI (Prompt Engineering & Full Stack).Location : Remote / United States / India.Product Stage : (Stealth Mode) AI Product Platform for Healthcare.
We’re a growing healthtech startu...Show moreLast updated: 1 day ago
- Promoted
Firmware Engineer
ConfidentialVadodara, India Xylem is a Fortune 500 global water solutions company dedicated to advancing sustainable impact and empowering the people who make water work every day.
As a leading water technology company with 23...Show moreLast updated: 30+ days ago