Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • Chennai, IN
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • Chennai, IN
7 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • Chennai, IN

    Related jobs
    Generative AI Engineer

    Generative AI Engineer

    Sesheng Company • Chennai, IN
    GenAI Engineer (Semantic Search & RAG Systems).Remote in India (to work in US Time zone).You will be instrumental in designing and deploying a cutting-edge semantic search capability to power our n...Show more
    Last updated: 20 days ago • Promoted
    Senior AI Engineer

    Senior AI Engineer

    BeGig • Chennai, IN
    We are looking for an experienced.The ideal candidate should be proficient in FastAPI, Python, LangChain, and modern AI application design. You will be responsible for designing, developing, and dep...Show more
    Last updated: 3 hours ago • Promoted • New!
    AI Engineer

    AI Engineer

    Asite • Chennai, IN
    We start with a simple idea : the built environment should be smarter, safer and more sustainable.Everything we do is about helping the people behind major construction and infrastructure projects w...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Chennai, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    LTIMindtree • Chennai, Tamil Nadu, India
    Ready to trade your to-do list for a to-do the impossible list?.Join a team that's building the future of IIOT.We have arranged a Walk-In Drive on 1-Nov ( Saturday). Location : L&T Innovation Campus...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    Luxoft • Chennai, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 16 days ago • Promoted
    Lead AI Engineer

    Lead AI Engineer

    Blend • Chennai, Tamil Nadu, India
    We are looking for a Manager / Lead AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edg...Show more
    Last updated: 12 days ago • Promoted
    AI Engineer

    AI Engineer

    Capabiliq INC • Chennai, Tamil Nadu, India
    CapabiliQ is seeking an experienced.The ideal candidate will be responsible for designing, developing, and deploying intelligent systems that leverage advanced AI models and automation workflows.Th...Show more
    Last updated: 20 days ago • Promoted
    AI Engineer

    AI Engineer

    Aura Recruitment Solutions • Chennai, IN
    Pay starts from 150,000 INR per Month.We’re hiring on behalf of our client, a fast-growing, AI-first company building cutting-edge AI-native applications that transform complex, real-world data int...Show more
    Last updated: 14 days ago • Promoted
    AI Engineer

    AI Engineer

    TechKareer • Chennai, IN
    Mumbai / Bengaluru / Gurgaon (Hybrid : 3 days / week in office).Remote option for exceptional candidates.We’re building production-grade AI workflows and agentic applications that power real user expe...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    Ascendion • Chennai, Tamil Nadu, India
    OCR Tools (Azure Doc Intelligence / Tesseract / John Snow Labs).Image Pre-processing (denoising / enrichment) in OCR pipeline. Frameworks / Platforms - Langchain / LlamaIndex / CrewAI / Semantic Ker...Show more
    Last updated: 17 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    LTIMindtree • Chennai, IN
    This role demands deep expertise in.Architect end-to-end GenAI solutions for R&D use cases such as.Evaluate multiple solution approaches (e. Document architectural decisions with.Word, Excel, PDF, d...Show more
    Last updated: 4 days ago • Promoted
    AI Engineer

    AI Engineer

    Idea Elan India • Chennai, IN
    AI Engineer (2 - 4 Years Experience).Idea Elan LLC is a product based company that provides comprehensive software solutions for. Universities and Institutions worldwide.We are seeking a skilled AI ...Show more
    Last updated: 6 days ago • Promoted
    AI Engineer

    AI Engineer

    Uplevyl • Chennai, IN
    Through our AI-powered agents, we’re building scalable, agentic community systems that reduce manual work and increase member engagement—especially for women-centric organizations.Someone who under...Show more
    Last updated: 3 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Aceolution • Chennai, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    TechWaves Recruitment • Chennai, IN
    Location : Role is remote, however you must be based within a City location in India.Our client who provides world’s leading Agent and Agentic solution platform designed for teams looking to streaml...Show more
    Last updated: 19 days ago • Promoted
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent Partner • Chennai, IN
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show more
    Last updated: 20 days ago • Promoted
    AI / ML Engineer - Agentic AI

    AI / ML Engineer - Agentic AI

    Intellectt Inc • Chennai, IN
    Our client is hiring an Agentic AI Engineer to design and deploy autonomous AI systems for healthcare-focused enterprise applications. The role involves building agentic workflows using LangChain / La...Show more
    Last updated: 3 hours ago • Promoted • New!