Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • Bangalore, IN
No longer accepting applications
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • Bangalore, IN
8 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • Bangalore, IN

    Related jobs
    AI Engineer

    AI Engineer

    TechWaves Recruitment • Bengaluru, IN
    Location : Role is remote, however you must be based within a City location in India.Our client who provides world’s leading Agent and Agentic solution platform designed for teams looking to streaml...Show more
    Last updated: 21 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • Bangalore Rural, Karnataka, India
    Locations - Hyderabad, Bangalore & Kolkata.Required Notice Period - Immediate Joiners or max up to 60 days.Should be working with Generative AI. Should be working with Machine Learning (ML).To apply...Show more
    Last updated: 1 hour ago • Promoted • New!
    AI & Data Analytics Engineer

    AI & Data Analytics Engineer

    Amphenol • Bangalore Urban district, India, India
    We are seeking a highly motivated.This role will play a critical part in modernizing and streamlining our testing processes through automation,. The Analyst will collaborate with auditors and stakeh...Show more
    Last updated: 30+ days ago • Promoted
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turing • Bengaluru, Karnataka, India
    Role Overview : We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve...Show more
    Last updated: 20 days ago • Promoted
    Data Engineer

    Data Engineer

    HCLTech • Greater Bengaluru Area, India
    F2F Hackathon scheduled on 22nd Nov 2025.If you are passionate about building scalable data solutions on Google Cloud and enjoy solving real-time data engineering challenges, this is the perfect op...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer+ AWS

    AI Engineer+ AWS

    LTIMindtree • Bengaluru, Karnataka, India
    Primary Skills - GenAI, Azure, Machine Learning, Data Science, Python.Location - Bangalore / Bengaluru, Bhubaneswar Chennai - Tamil Nadu, Coimbatore, Hyderabad, Kolkata, Lucknow Mumbai - Powai, Mum...Show more
    Last updated: 8 days ago • Promoted
    AI Data Engineer

    AI Data Engineer

    Tata Consultancy Services • Bangalore Urban, Karnataka, India
    Build and maintain data infrastructure : Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud. Ensure data quality : Clean, transform, and enrich raw da...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    Lara Tech Consulting • Bengaluru, Karnataka, India
    This is an urgent requirement – Immediate joiners only.We are looking for a hands-on AI Engineer with strong exposure to. Agentic AI frameworks, LLM pipelines, and Model Context Protocol (MCP).The i...Show more
    Last updated: 6 days ago • Promoted
    Principal AI Engineer

    Principal AI Engineer

    Target • Greater Bengaluru Area, India
    As a Fortune 50 company with more than 400,000 team members worldwide, Target is an iconic brand and one of America's leading retailers. Target in India operates as a fully integrated part of Target...Show more
    Last updated: 3 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • Greater Bengaluru Area, India
    TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Required Skill Set : AWS...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer (DOMO & Python / Kafka)

    Data Engineer (DOMO & Python / Kafka)

    Smart Moves Consultants • hosur, tamil nadu, in
    We are looking for candidates with strong Domo and Python / Kafka connect experience.Please find the JD below and share suitable and strong profiles at the earliest. Design, build, and maintain scala...Show more
    Last updated: 7 hours ago • Promoted • New!
    AI Engineer

    AI Engineer

    Asite • Bangalore, IN
    We start with a simple idea : the built environment should be smarter, safer and more sustainable.Everything we do is about helping the people behind major construction and infrastructure projects w...Show more
    Last updated: 4 days ago • Promoted
    AI Engineer

    AI Engineer

    In Time Tec • Bengaluru, Karnataka, India
    At In Time Tec, we believe in creating abundance through trust, transparency, and long-term partnerships.As a global technology company, we empower businesses to transform digitally with scalable s...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer (Conversational Analytics & GenAI Systems)

    AI Engineer (Conversational Analytics & GenAI Systems)

    IRISS, Inc. • bangalore, karnataka, in
    Our commitment to pushing boundaries and delivering exceptional solutions has positioned us as a trusted partner for clients seeking top-tier technical expertise in Condition Based Monitoring.IRISS...Show more
    Last updated: 19 days ago • Promoted
    Data Engineer (Airflow, Azure)

    Data Engineer (Airflow, Azure)

    Luxoft • Greater Bengaluru Area, India
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 11 hours ago • Promoted • New!
    AI Lead Engineer

    AI Lead Engineer

    TekGenio • Bangalore, IN
    Experience : 5+ Years | Type : Full-Time | Location : WFH.Minimum of 5+ years of experience in AI / ML engineering, data science, or algorithm development. Strong experience in machine learning, deep lea...Show more
    Last updated: 11 hours ago • Promoted • New!
    Lead AI Engineer

    Lead AI Engineer

    Credit Saison India • Bengaluru, Karnataka, India
    Established in 2019, Credit Saison India (CS India) is one of the country’s fastest growing Non-Bank Financial Company (NBFC) lenders, with verticals in wholesale, direct lending and tech-enabled p...Show more
    Last updated: 12 days ago • Promoted
    AWS Data Engineer ( 5- 10 Years)- WalkIn Drive - 29th Nov25, Bangalore

    AWS Data Engineer ( 5- 10 Years)- WalkIn Drive - 29th Nov25, Bangalore

    Tata Consultancy Services • Greater Bengaluru Area, India
    Mode of Interview : Face to Face (29th Nov-25).Strong hands-on experience with AWS Data Services : .Amazon S3, Glue, Redshift, Athena, Kinesis, EMR. Expertise in AWS AI / ML Services : .Amazon SageMaker, ...Show more
    Last updated: 11 hours ago • Promoted • New!