Talent.com
No longer accepting applications
Generative AI Engineer

Generative AI Engineer

TestZeusmadurai, tamil nadu, in
8 days ago
Job description

Location : Bangalore (Office)

Experience : 4–5 years

Role Type : Full-time

About TestZeus

TestZeus is pioneering the next generation of AI-powered software testing. We’re the team behind Hercules, the world’s first open-source testing agent. By combining large language models, multi-agent orchestration, and state-of-the-art retrieval pipelines, we deliver autonomous, zero-maintenance testing for web and API workloads. We are seeking an AI Engineer (4–5 years experience) who can design, build, and scale production-grade LLM systems. This is a hands-on product role where you’ll work closely with backend, frontend, and product teams to ship quickly, test with real users, and iterate in production. If you enjoy building RAG systems, prompt workflows, and agentic evaluation that solve real business problems, this role is for you.

Key Responsibilities

1. LLM Workflow & Prompt Engineering

  • Design, build, and maintain LLM workflows that score freeform answers, generate contextual feedback, and assist users in real time.
  • Develop and refine prompt templates, chains, and tools to improve relevance, reduce token usage, and mitigate hallucinations.
  • Implement multi-step prompt workflows for tasks like mock interviews, code reviews, and automated test guidance.

2. Retrieval & RAG Pipelines

  • Build and optimise retrieval-augmented generation (RAG) pipelines using vector stores (e.g., Pinecone, Weaviate, Elasticsearch).
  • Implement embedding generation, similarity search, and dynamic context selection that reduce hallucinations and improve answer quality.
  • Ensure low-latency, high-accuracy retrieval combined with LLM generation for highly personalised user experiences.
  • 3. LLM Evaluation & Analytics

  • Define and implement evaluation frameworks for LLM outputs : accuracy, consistency, bias, interpretability, and robustness.
  • Build automated evaluation pipelines that monitor performance over time, detect regression, and flag failure modes.
  • Instrument systems with metrics and logging to understand model behaviour in production and drive data-informed decisions.
  • 4. Agent-Based System Development

  • Build tool-augmented agents capable of evaluating coding, system design, or reasoning questions using frameworks like LangChain, AutoGen, LlamaIndex, or similar.
  • Design and experiment with agent orchestration patterns (multi-agent workflows, planners, evaluators) to improve multi-step reasoning and reliability.
  • Integrate agents with external tools and APIs (code execution, documentation search, test runners, etc.) to extend capabilities.
  • 5. Cross-Functional Collaboration & Product Impact

  • Partner with backend engineers (Go, FastAPI) and frontend engineers (React) to ship features end-to-end.
  • Work closely with product managers and designers to shape user journeys, gather feedback, and iterate quickly in production.
  • Participate in agile ceremonies (standups, sprint planning, retrospectives) and provide clear, consistent status updates.
  • 6. Research, Experimentation & Innovation

  • Stay current with state-of-the-art LLM and retrieval research, benchmarks, and open-source tools.
  • Rapidly prototype new ideas (e.g., advanced retrieval strategies, custom fine-tuning flows, new evaluation methods) and demonstrate feasibility.
  • Contribute to internal best practices, playbooks, and reusable components for LLM and agent development.
  • Qualifications & Skills Education

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or equivalent professional experience.
  • Experience

  • 4–5 years of professional software engineering experience, with a strong focus on Python.
  • At least 2 years of hands-on experience building and deploying LLM-powered applications in production (beyond toy projects).
  • Core Skills

    LLM & Prompt Engineering

  • Proven experience designing prompt workflows, tools, and chains for production use.
  • Familiarity with OpenAI, Claude, and / or open-weight LLMs (e.g., Hugging Face ecosystem).
  • Experience with LangChain, LlamaIndex, AutoGen, or equivalent frameworks for chains / agents.
  • Retrieval & RAG

  • Built at least one end-to-end RAG pipeline integrating vector search (Pinecone, Weaviate, Elasticsearch, or similar) with LLMs.
  • Understanding of embeddings, similarity search, reranking, and dynamic context selection for reducing hallucinations.
  • Evaluation Frameworks

  • Experience defining LLM output quality metrics (accuracy, consistency, bias, interpretability).
  • Implemented automated evaluation or testing pipelines to monitor LLM behaviour and aggregate performance statistics.
  • Python Engineering

  • Strong Python skills and experience building production services using frameworks like FastAPI, Flask, or similar.
  • Good understanding of data preprocessing, ETL flows, and integration patterns for AI / ML components.
  • Familiarity with testing, observability, and integration testing for AI systems.
  • Collaboration & Product Mindset

  • Demonstrated ability to work in cross-functional teams (backend, product, UX) within an Agile / Scrum environment.
  • Ability to translate research concepts and technical trade-offs to non-technical stakeholders.
  • Product mindset : you care deeply about user experience, measurable impact, and iteration speed.
  • Preferred

  • Hands-on experience with vector databases & semantic search (Pinecone, Weaviate, pgvector, Elasticsearch, etc.).
  • Domain exposure to developer tooling, QA / testing platforms, edtech, or hiring / assessment products.
  • Experience with fine-tuning LLMs or building lightweight custom models.
  • Interest in growing into a Founding AI Lead role as TestZeus scales.
  • Why Join TestZeus?

  • Real Impact : Own and shape the AI systems that power our flagship testing platform, impacting quality for thousands of users.
  • Cutting-Edge Environment : Work with SOTA LLMs, agents, and retrieval systems, and get space to prototype bold ideas.
  • High Ownership : Small, talented team where your decisions and code directly shape the product and company direction.
  • Learning & Growth : Regular tech talks, deep dives into research, and support for conferences, workshops, and open-source work.
  • Bangalore – Work From Office : Collaborate closely with the team, iterate quickly, and build a strong product culture together.
  • Application Process

    To apply, please share the following details with us :

  • Your CV
  • Your Current and Expected CTC
  • Months of experience building LLM applications and / or AI agents
  • Links to Public Work (e.g., GitHub, Medium, personal website, open-source contributions)
  • 📬 Send everything to : hiring@testzeus.com

  • We’re excited to review your application!
  • Create a job alert for this search

    Generative Ai Engineer • madurai, tamil nadu, in

    Related jobs
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Turingmadurai, tamil nadu, in
    Turing is looking for people with LLM experience to join us in solving business problems for our Fortune 500 customers.You will be a key member of the Turing GenAI delivery organization and part of...Show moreLast updated: 15 days ago
    • Promoted
    AI Engineer

    AI Engineer

    AsiteDindigul, IN
    We start with a simple idea : the built environment should be smarter, safer and more sustainable.Everything we do is about helping the people behind major construction and infrastructure projects w...Show moreLast updated: 1 day ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    People Prime WorldwideDindigul, IN
    Description : Generative AI / AI & ML Engineer.Years (Minimum 2 years in AI / ML).Develop, fine-tune, and optimize generative AI models (LLMs, diffusion models, transformers, etc.Build AI-powered appl...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    MightyBotDindigul, IN
    Join our team as an AI Engineer, where we're focused on graduating AI from interesting demos to indispensable products.You will build reliable, self-improving systems that empower subject matter ex...Show moreLast updated: 30+ days ago
    • Promoted
    Remote GenAI Engineer

    Remote GenAI Engineer

    EazyMLMadurai, IN
    Remote
    Founded by Bell Labs research veterans, and associated with breakthrough startups like Amelia, EazyML, specializes in Transparent Machine Learning. Early on EazyML founders saw the need for Transpa...Show moreLast updated: 30+ days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Qubrid AIMadurai, IN
    Work from Home! Compensation 8-9 LPA.Plus Please do not apply if compensation is not acceptable.Qubrid AI is a leading provider of high-performance GPU cloud infrastructure and advanced AI software...Show moreLast updated: 2 days ago
    • Promoted
    AI Agent Architect

    AI Agent Architect

    LuxoftDindigul, IN
    We are seeking a hands-on and qualified AI Agent Architect to design and deploy advanced Agentic AI systems—comprising task-specific autonomous tools governed by a master agent—to support complex t...Show moreLast updated: 12 days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    CodewallaDindigul, IN
    Codewalla is a New York–based product studio with engineering teams in India.Since 2005, we’ve built innovative products that scale. We work at the intersection of design, engineering, and AI develo...Show moreLast updated: 30+ days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    LTIMindtreeMadurai, IN
    This role demands deep expertise in.Architect end-to-end GenAI solutions for R&D use cases such as.Evaluate multiple solution approaches (e. Document architectural decisions with.Word, Excel, PDF, d...Show moreLast updated: 3 days ago
    • Promoted
    Agentic AI Engineer

    Agentic AI Engineer

    Intellectt IncMadurai, IN
    Agentic AI Engineer (100% Remote).Intellectt is seeking a highly experienced.The ideal candidate will have hands-on expertise in. LLMs, LangChain, LangGraph, RAG.AI applications for real-world use.O...Show moreLast updated: 12 days ago
    • Promoted
    AI Engineer

    AI Engineer

    Aura Recruitment SolutionsMadurai, IN
    Pay starts from 150,000 INR per Month.We’re hiring on behalf of our client, a fast-growing, AI-first company building cutting-edge AI-native applications that transform complex, real-world data int...Show moreLast updated: 12 days ago
    • Promoted
    AI Engineer

    AI Engineer

    TechWaves RecruitmentMadurai, IN
    Location : Role is remote, however you must be based within a City location in India.Our client who provides world’s leading Agent and Agentic solution platform designed for teams looking to streaml...Show moreLast updated: 18 days ago
    • Promoted
    Lead AI Engineer

    Lead AI Engineer

    BlendDindigul, IN
    We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show moreLast updated: 14 days ago
    • Promoted
    AI Engineer

    AI Engineer

    Idea Elan IndiaDindigul, IN
    AI Engineer (2 - 4 Years Experience).Idea Elan LLC is a product based company that provides comprehensive software solutions for. Universities and Institutions worldwide.We are seeking a skilled AI ...Show moreLast updated: 4 days ago
    • Promoted
    AI Engineer

    AI Engineer

    Tensor PilotDindigul, IN
    Tensor Pilot, through its flagship product Tensor AI, provides a sophisticated desktop-based AI assistant for interacting with local files such as code, documents, images, and videos.Tensor AI emph...Show moreLast updated: 1 day ago
    • Promoted
    AI Platform Engineer

    AI Platform Engineer

    BayOne SolutionsMadurai, IN
    We are seeking a highly skilled.In this role, you will work on advanced AI systems including.Retrieval-Augmented Generation (RAG). Model Context Protocol (MCP) tools.OpenWebUI or custom-built soluti...Show moreLast updated: 9 days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Live ConnectionsDindigul, IN
    We’re Hiring | Generative AI Lead / Principal Engineer.Are you passionate about building cutting-edge.Generative AI and LLM solutions. We’re looking for an experienced.Generative AI Lead / Principal...Show moreLast updated: 10 days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Sesheng CompanyMadurai, IN
    GenAI Engineer (Semantic Search & RAG Systems).Remote in India (to work in US Time zone).You will be instrumental in designing and deploying a cutting-edge semantic search capability to power our n...Show moreLast updated: 18 days ago