No longer accepting applications
Prompt Engineer
Webknot TechnologiesMount Abu, IN6 hours ago
Job description1–4 years of experience in QA, automation testing, AI validation, or NLP-based systems. Hands-on experience with LLM testing or evaluation (e.g., GPT, Claude, Gemini, or similar models). Strong understanding of software QA methodologies, testing types, and debugging processes. Proficiency in Java or another programming language for automation and testing workflows. Knowledge of GenAI concepts such as context handling, temperature tuning, and prompt behavior analysis. Excellent analytical, problem-solving, and documentation skills. Strong communication and collaboration skills for cross-functional teamwork. Experience with Agentic AI frameworks, LLMOps, or LLM evaluation tools such as DeepEval or LangChain. Familiarity with REST APIs, Postman, or cloud-based AI platforms (OpenAI, Anthropic, Vertex AI, etc.). Exposure to CI / CD pipelines, automated QA tools, or AI model monitoring systems.
Experience : 1–4 Years
Location : Bangalore (Onsite)
About the Role :
We are seeking an Agentic Automation QA Engineer with 1–4 years of experience to test, validate, and enhance Generative AI (GenAI) and Agentic automation workflows. The ideal candidate should possess a strong understanding of software testing principles, prompt evaluation, and LLM-based application behavior.
Candidates with Java programming experience will be given preference.
Key Responsibilities :
- Design, develop, and execute test cases for Agentic workflows and AI-driven automation processes.
- Validate AI agent behaviors, responses, and decision-making logic to ensure correctness, stability, and reliability.
- Evaluate and benchmark LLM outputs for accuracy, coherence, consistency, and alignment with defined objectives.
- Collaborate with developers, data scientists, and prompt engineers to identify and resolve issues across automation pipelines.
- Develop automated test frameworks or scripts for repeatable validation of GenAI features and Agentic components.
- Maintain detailed documentation of test plans, scenarios, and results for continuous improvement.
- Stay updated on LLM testing methodologies, Agentic frameworks, and emerging trends in AI automation QA.
Required Skills & Qualifications :
Good to Have
Create a job alert for this search
Engineer • Mount Abu, IN
Related jobs
![Engineer - Fullstack [T500-20529]](https://cdn-logos.talent.com/v1/logo/image?feedcode=clickcast-appcast-li-in-cpc&company_name=ANSR)
)
- Promoted
Prompt Engineer
Zetheta Algorithms Private LimitedMount Abu, IN ZeTheta Algorithms Private Limited is a FinTech start-up which has been recently set up and is developing innovative AI tools.
We are seeking a talented and motivated student intern for Portfolio Ma...Show moreLast updated: 30+ days ago
- Promoted
Werum PAS-X Engineer EXP : 2 to 6 years - Location Pune / Mumbai
Capgemini EngineeringMount Abu, IN Having experience on WERUM PAS-X Installation qualifications and version upgradation in the server client architecture.Expert in PAS-X system administration and configuration, ideally based on vers...Show moreLast updated: 30+ days ago
- Promoted
Engineer - Fullstack [T500-20529]
ANSRMount Abu, IN ANSR is hiring for one of its clients.ArcelorMittal was formed in 2006 from the strategic merger of European company Arcelor and Indian-owned Mittal Steel.
Over a journey of two decades, we have eme...Show moreLast updated: 30+ days ago
- Promoted
Deployment Engineer
AvocaMount Abu, IN Build, launch & optimize AI agents that power the next generation of home-service customer experiences.Avoca is the all-in-one AI lead-conversion platform.
Our technology boosts booking rates, slash...Show moreLast updated: 30+ days ago
- Promoted
iSeries Engineer
Insight GlobalMount Abu, IN Position : iSeries Developer / Software Engineer.Company : Insight Global Customer.Max CTC Available : 30LPA fixed Pay.MUST be able to join in 30 days or less for critical go live.Minimum of 3 years of ...Show moreLast updated: 6 days ago
- Promoted
Automation Estimation & Proposal Engineer
Q4S Digital TransformationMount Abu, IN Q4S is a next-generation digital transformation platform designed to empower industries with automation, intelligence, and efficiency.
We bring together SCADA, IoT, cloud, analytics, and AI to creat...Show moreLast updated: 6 days ago
- Promoted
Senior Engineer - Protocols
RecroMount Abu, IN As a Software Engineer, you will play a key role in enhancing our cloud-scale NAS platform.Your responsibilities will include : .
Collaborating on requirements analysis, design reviews to evolve Nasun...Show moreLast updated: 27 days ago
- Promoted
Principal Protocol_ Kubernetes
RecroMount Abu, IN As a Principal Software Engineer - Protocols, you will play a key role in enhancing our cloud-scale NAS platform.Your responsibilities will include : .
Participate and lead requirements analysis, arch...Show moreLast updated: 27 days ago
- Promoted
Junior Engineer, Product Platform Hardware (FPGA)
NIKSUNMount Abu, IN Junior Engineer, Product Platform Hardware (FPGA) : .NIKSUN is the recognized worldwide leader in making the Unknown Known.
The company develops and deploys a complete range of award-winning forensics...Show moreLast updated: 6 days ago
- Promoted
Emulation Engineer / Lead
eInfochips (An Arrow Company)Mount Abu, IN Role : Emulation Engineer / Lead.Job Location : Noida, Chennai, Bangalore, Hyderabad, Ahmedabad.You must be having BS or MS in Electrical OR Electronics engineering.
Minimum 4+ Years of Emulation Expe...Show moreLast updated: 30+ days ago
- Promoted
Procurement Engineer
SD Industries, LLCMount Abu, IN SD Industries, LLC is a leading construction and fabrication company committed to delivering high-quality projects on time and within budget.
We are seeking a skilled Procurement Manager to lead our...Show moreLast updated: 30+ days ago
- Promoted
Principal Technical Engineer(Configurations)
Qinecsa SolutionsMount Abu, IN We are seeking a Principal Technical Engineer to develop and deploy client configurations for our flagship Qinecsa Vigilance Workbench signal detection platform.
The ideal candidate will be dynamic ...Show moreLast updated: 27 days ago
- Promoted
Senior Site Reliability Engineer- ELK Expert
iVedha Inc.Mount Abu, IN Senior Site Reliability Engineer (SRE) – ELK Expert | Platform Engineering Practice.Must be available to work in the EST (US / Canada) Time Zone.
Are you a Senior Site Reliability Engineer (SRE) with ...Show moreLast updated: 30+ days ago
- Promoted
Prompt Engineer
Innodata Inc.Mount Abu, IN Demonstrated experience programmatically using LLMs to automate data labeling, classification, localization and annotation tasks.
Strong expertise in Python for NLU, for data processing & transforma...Show moreLast updated: 6 days ago
- Promoted
Delinea Implementation Engineer
K&K Talents - IndiaMount Abu, IN This position is with one of our.Title : Delinea Implementation Engineer.Employment Type : Full-time Permanent.Delinea Implementation Engineer.
Delinea (formerly Thycotic & Centrify) Privileged Access...Show moreLast updated: 19 days ago
- Promoted
RPA Engineer - Web Form Automation
PropertyLoopMount Abu, IN Job Title : RPA Engineer – Web-Form Automation.Location : India – Remote (core overlap with GMT + IST).Employment Type : Full-time, Permanent.
Reports To : Lead Technologist & Product Strategy Liaison (...Show moreLast updated: 30+ days ago
- Promoted
Prompt & AI / ML Engineer – Chatbot Voice Agent LLM & RAG
QuantumLoopAiMount Abu, IN Prompt & AI / ML Engineer – Chatbot LLM & RAGOverview.UK’s leading AI receptionist for GP practices.By combining cutting-edge Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), advan...Show moreLast updated: 3 days ago
- Promoted
AS400 / SYNON
CognizantMount Abu, IN Design, develop, test, and implement applications on AS / 400.Work with RPG IV, RPGLE, CL, and DB2 / 400 for development and support.
Analyze user requirements and business processes to develop effectiv...Show moreLast updated: 17 days ago