Talent.com
Gen AI Architect

Gen AI Architect

Prana TreeBengaluru, Karnataka, India
3 days ago
Job description

Job Title : Gen AI Architect

Experience : 8 – 12 Years

Work Mode : Work from Office (WFO)

Locations : Chennai | Bangalore | Hyderabad

Position Overview We are looking for an experienced GenAI Architect to lead the design and implementation of cutting-edge Generative AI solutions that drive innovation, scalability, and enterprise transformation.

This role demands deep expertise in LLM-based architectures , RAG (Retrieval-Augmented Generation) systems, agentic workflow orchestration , and MLOps deployment . The ideal candidate will combine strong hands-on technical skills with architectural vision, ensuring secure, compliant, and high-performance GenAI ecosystems.

Key Responsibilities

Generative AI (GenAI) Architecture

  • Architect and design enterprise-grade LLM-based systems optimized for performance, scalability, and reliability.
  • Demonstrate strong understanding of vector embeddings , similarity search (cosine / IP / L2), chunking strategies , and reranking .
  • Build and optimize RAG pipelines — including indexing, metadata, hybrid search, and evaluator frameworks.
  • Apply prompt engineering for tool use, function calling, and multi-agent planning.
  • Develop and orchestrate agentic workflows using frameworks such as LangGraph or similar; integrate tools / services via MCP-compatible patterns .
  • Implement NL2SQL approaches, ensuring SQL safety through schema constraints, sandboxes, and secure API integrations.
  • Evaluate and balance trade-offs between generic LLMs and fine-tuned models , optimizing for accuracy, latency, and operational cost.
  • Embed security, compliance, and data governance principles within all AI workflows, including RBAC / ABAC, auditability, and privacy controls.

MLOps & Deployment

  • Manage end-to-end deployment using frameworks such as MLflow , Kubeflow , SageMaker , or Vertex AI .
  • Implement CI / CD pipelines for AI models, ensuring consistent delivery and robust version control.
  • Utilize Docker and Kubernetes for model containerization, orchestration, and scalability.
  • Establish monitoring, tracing, and observability for model performance, latency, and cost metrics.
  • Preferred Experience

  • Hands-on experience with cloud platforms such as AWS , Azure , GCP , or OCI .
  • Strong understanding of large-scale distributed systems and big-data frameworks (Spark, Hadoop).
  • Expertise in retrieval optimization (hybrid lexical + vector search, metadata filtering, rerankers).
  • Knowledge of model fine-tuning and adapter techniques ( LoRA, SFT, DPO ) with evaluation best practices.
  • Experience in Document AI , layout parsing , and schema design for unstructured data.
  • Familiarity with observability stacks for LLM applications — tracing, evaluation dashboards, and performance SLOs.
  • Understanding of caching, batching , and KV-cache strategies for improved throughput and cost optimization.
  • Exposure to secure tool-use patterns , constrained decoding, and policy-based control mechanisms.
  • Assessment Framework

  • Portfolio Review : Evaluation of production-ready RAG or agentic systems, including design, architecture, and measurable outcomes.
  • Technical Exercise : Design an intent router, justify model selection (base vs. fine-tuned), propose chunking / metadata strategies, and define evaluation metrics.
  • Scenario Discussion : Identify and mitigate failure modes (hallucinations, tool errors, SQL risk).
  • Governance Evaluation : Demonstrate understanding of access controls, PII handling, audit logging, and red-teaming practices.
  • Qualifications

  • Bachelor’s or Master’s degree in Computer Science , Artificial Intelligence , Data Engineering , or a related discipline.
  • 8–12 years of total experience, including at least 3+ years in AI / ML architecture or Gen AI system design .
  • Proficiency in Python , LLM / RAG frameworks , and modern containerization and CI / CD workflows .
  • Strong communication, leadership, and problem-solving abilities with a focus on delivering business-impactful AI solutions.
  • Create a job alert for this search

    Ai Architect • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    Agentic AI Engineer

    Agentic AI Engineer

    BeGighosur, tamil nadu, in
    Agentic AI Engineer – Real Estate & Construction.We are seeking a talented engineer to.You will own the full lifecycle of agent frameworks, including toolchain architecture, prompt engineering, dat...Show moreLast updated: 2 days ago
    • Promoted
    Gen AI Architect

    Gen AI Architect

    Prana TreeBengaluru, Karnataka, India
    Chennai | Bangalore | Hyderabad.We are looking for an experienced.Generative AI solutions that drive innovation, scalability, and enterprise transformation. This role demands deep expertise in.RAG (...Show moreLast updated: 4 days ago
    • Promoted
    Gen AI Architect

    Gen AI Architect

    IGT SolutionsBangalore, IN
    Job Title : Architect - Gen AI, LLM, Big Data.We are looking for an experienced Architect with deep expertise in Generative AI (Gen AI), Large Language Models (LLM), and Big Data technologies.The id...Show moreLast updated: 4 days ago
    • Promoted
    GenAI Architect

    GenAI Architect

    AIONOSBengaluru, Karnataka, India
    We are seeking a highly motivated and experienced AI Solution Architect (Data Scientist) to join our growing team.In this critical role, you will play a pivotal role in designing and developing inn...Show moreLast updated: 4 days ago
    • Promoted
    Solutions Architect - AI

    Solutions Architect - AI

    Tata Consultancy ServicesGreater Bengaluru Area, India
    AI, automation, or low-code platforms.Hands-on experience with Microsoft Copilot Studio, Power Platform, and Azure AI services. Strong understanding of declarative and custom-engine agent developmen...Show moreLast updated: 1 day ago
    • Promoted
    AI / ML / GenAI Architect

    AI / ML / GenAI Architect

    ACL DigitalBengaluru, Karnataka, India
    Minimum of 3 successful end-to-end project implementations of AI / ML / GenAI solutions in production environments, demonstrating strong business impact and scalability. Deep expertise in Generative AI ...Show moreLast updated: 25 days ago
    • Promoted
    AI / GenAI Solution Architect

    AI / GenAI Solution Architect

    RecroBengaluru, Karnataka, India
    Python, GenAI, LLM Architecture, Azure AI, CoPilot Development, Agentic Frameworks, MLOps / LLMOps, Data Engineering, Solution Architecture, RFP & Client Engagement. AI / ML, LLMs, and Agentic Framework...Show moreLast updated: 2 days ago
    • Promoted
    Gen AI Engineer

    Gen AI Engineer

    ADPhosur, tamil nadu, in
    We are seeking a highly skilled and experienced Senior Generative AI Engineer to lead the development of intelligent agents powered by advanced generative AI models. In this role, you will be respon...Show moreLast updated: 23 days ago
    • Promoted
    GEN AI Developer

    GEN AI Developer

    Best Infosystems Ltd.Greater Bengaluru Area, India
    GEN AI Developer_Full-time_Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai.Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai. Gen Ai, Azure Open Ai, Python and which are mentions in cheat sheet....Show moreLast updated: 30+ days ago
    • Promoted
    Generative AI Architect

    Generative AI Architect

    ITC InfotechBengaluru, Karnataka, India
    Hi, We have the following role open in Bangalore, Interested candidates can send their detailed profile to manikandan.Current CTC, Expected CTC and Notice period to join. We are seeking a visionary ...Show moreLast updated: 1 day ago
    • Promoted
    GEN AI ARCHITECT

    GEN AI ARCHITECT

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Bachelor’s degree in computer science, Data Science, or a related field; master’s degree preferred.Be an expert source on machine learning to drive delivery of new and innovative solutions.Propose ...Show moreLast updated: 30+ days ago
    • Promoted
    GEN AI Sr. Developer

    GEN AI Sr. Developer

    Best Infosystems Ltd.Greater Bengaluru Area, India
    Developer_Full-time_Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai.Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai. Gen Ai, Azure Open Ai, Python and which are mentions in cheat sheet.Senior ...Show moreLast updated: 30+ days ago
    • Promoted
    Gen AI Architect

    Gen AI Architect

    LTIMindtreeBengaluru, Karnataka, India
    Drive enterprise-scale AI strategy, architecture, and delivery—enabling agentic, autonomous, and orchestrated AI solutions that align with business outcomes and compliance standards.Data & Analytic...Show moreLast updated: 4 days ago
    • Promoted
    Gen AI Architect

    Gen AI Architect

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Job Role : Gen AI Architect Experience : 8 to 15 Years Location : Bengaluru, Hyderabad, Chennai, Mumbai Must Have : GenAI Application Development Expertise Programming Languages : Python Develop...Show moreLast updated: 30+ days ago
    • Promoted
    Gen Ai - Engineer

    Gen Ai - Engineer

    Diligente Technologieshosur, tamil nadu, in
    Hands-on experience with Generative AI (GenAI) and agent-based AI frameworks.Proficiency in backend programming languages such as Node. Strong knowledge of both SQL and NoSQL databases.Experience wi...Show moreLast updated: 23 days ago
    • Promoted
    Gen AI Developer

    Gen AI Developer

    Tata Consultancy Serviceshosur, tamil nadu, in
    Experience in designing, developing, and implementing generative AI models and algorithms utilizing state-of-the-art techniques such as GPT, VAE, GANs & LLMs. Generate required data using data gener...Show moreLast updated: 30+ days ago
    • Promoted
    AI Architect

    AI Architect

    Persistent Systemshosur, tamil nadu, in
    We are seeking a highly skilled and innovative Agentic AI Developer to architect and implement intelligent, autonomous AI workflows and backend systems. This role is ideal for someone passionate abo...Show moreLast updated: 18 days ago
    • Promoted
    AI Architect

    AI Architect

    Tata Consultancy Serviceshosur, tamil nadu, in
    We are seeking a visionary AI Architect with 8 –15 years of overall experience to lead the strategic design and implementation of enterprise-scale AI solutions. This role requires deep expertise in ...Show moreLast updated: 24 days ago