Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • Bangalore, IN
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • Bangalore, IN
9 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • Bangalore, IN

    Related jobs
    AI Engineer

    AI Engineer

    TalentBridge • Bengaluru, Karnataka, India
    Job Type : 6-Month Contract, after 6 months it will convert to fulltime.Location : Bengaluru or Pune ( Hybrid - 3 days onsite, 2 days Remote ). We are looking for an experienced AIML Engineer with 4–8...Show more
    Last updated: 30+ days ago • Promoted
    AI / ML Pipeline Engineer

    AI / ML Pipeline Engineer

    Tata Consultancy Services • Bengaluru, Republic Of India, IN
    Job location : Bangalore, Chennai, Hyderabad, Kolkata, Trivandrum, Indore, Delhi NCR.Building and maintaining ML pipelines – from validation through to deployment and monitoring.Working closely wit...Show more
    Last updated: 16 days ago • Promoted
    AI Engineer

    AI Engineer

    Lara Tech Consulting • Bengaluru, Karnataka, India
    This is an urgent requirement – Immediate joiners only.We are looking for a hands-on AI Engineer with strong exposure to. Agentic AI frameworks, LLM pipelines, and Model Context Protocol (MCP).The i...Show more
    Last updated: 7 days ago • Promoted
    AI & Data Analytics Engineer

    AI & Data Analytics Engineer

    Amphenol • Bangalore Urban district, India, India
    We are seeking a highly motivated.This role will play a critical part in modernizing and streamlining our testing processes through automation,. The Analyst will collaborate with auditors and stakeh...Show more
    Last updated: 30+ days ago • Promoted
    Lead AI Engineer

    Lead AI Engineer

    APPIT Software Inc • Bengaluru, India
    Architect, build, and optimize production-grade Generative AI applications using modern frameworks such as LangChain, LlamaIndex, Semantic Kernel, or custom orchestration layers.Lead the design of ...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    AppsForBharat • Bengaluru, Republic Of India, IN
    We are looking for a Senior Data Engineer to lead the design and development of a next-generation data platform that powers real-time and batch applications at scale. This platform supports business...Show more
    Last updated: 23 days ago • Promoted
    AI Engineer+ AWS

    AI Engineer+ AWS

    LTIMindtree • Bengaluru, Karnataka, India
    Primary Skills - GenAI, Azure, Machine Learning, Data Science, Python.Location - Bangalore / Bengaluru, Bhubaneswar Chennai - Tamil Nadu, Coimbatore, Hyderabad, Kolkata, Lucknow Mumbai - Powai, Mum...Show more
    Last updated: 9 days ago • Promoted
    AI Data Engineer

    AI Data Engineer

    Tata Consultancy Services • Bengaluru, India
    Build and maintain data infrastructure : Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud. Ensure data quality : Clean, transform, and enrich raw da...Show more
    Last updated: 30+ days ago • Promoted
    Ai Engineer+ Aws

    Ai Engineer+ Aws

    LTIMindtree • Bengaluru, Republic Of India, IN
    Primary Skills - GenAI, Azure, Machine Learning, Data Science, Python.Location - Bangalore / Bengaluru, Bhubaneswar Chennai - Tamil Nadu, Coimbatore, Hyderabad, Kolkata, Lucknow Mumbai - Powai, Mum...Show more
    Last updated: 9 days ago • Promoted
    AI / ML Data Pipeline Engineer

    AI / ML Data Pipeline Engineer

    Selector • Bengaluru, Republic Of India, IN
    Selector is building an operational intelligence platform for digital infrastructure.By adopting an AI / ML-based analytics approach, the platform provides actionable multi-dimensional.It enables ope...Show more
    Last updated: 28 days ago • Promoted
    Data Engineer II (AI / ML) [T500-21411]

    Data Engineer II (AI / ML) [T500-21411]

    ADM • Bengaluru, Karnataka, India
    We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition.We unlock the power of nature to provide nourishing quality of life by transforming crops int...Show more
    Last updated: 15 days ago • Promoted
    Ai Engineer

    Ai Engineer

    Lara Tech Consulting • Bengaluru, Republic Of India, IN
    This is an urgent requirement – Immediate joiners only.We are looking for a hands-on AI Engineer with strong exposure to. Agentic AI frameworks, LLM pipelines, and Model Context Protocol (MCP).The i...Show more
    Last updated: 7 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    L&T Technology Services • Bengaluru, Republic Of India, IN
    PySpark, SQL, AWS and good to have Pandas.Show more
    Last updated: 7 days ago • Promoted
    AI Engineer (Data Pipelines & RAG)

    AI Engineer (Data Pipelines & RAG)

    BeGig • Bengaluru, IN
    Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
    Last updated: 9 days ago • Promoted
    AI / ML Data Pipeline Engineer

    AI / ML Data Pipeline Engineer

    ADM • Bengaluru, Republic Of India, IN
    We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition.We unlock the power of nature to provide nourishing quality of life by transforming crops int...Show more
    Last updated: 15 days ago • Promoted
    AI / ML Pipeline Engineer

    AI / ML Pipeline Engineer

    Lara Tech Consulting • Bengaluru, Republic Of India, IN
    This is an urgent requirement – Immediate joiners only.We are looking for a hands-on AI Engineer with strong exposure to. Agentic AI frameworks, LLM pipelines, and Model Context Protocol (MCP).The i...Show more
    Last updated: 7 days ago • Promoted
    Applied AI Engineer

    Applied AI Engineer

    neuroGrid • Bengaluru, Karnataka, India
    Bengaluru, India (Residency Road, In-Office, Full-Time).Engineering Manager, Bengaluru.Grid is a well-funded startup building a next-generation SaaS platform to accelerate the development of modern...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Emids • Bengaluru, Republic Of India, IN
    We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team. The ideal candidate will be responsible fo...Show more
    Last updated: 1 day ago • Promoted