Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • India, India
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • India, India
9 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • India, India

    Related jobs
    AI Pipeline Development Engineer

    AI Pipeline Development Engineer

    Strategic Talent Partner • Republic Of India, IN
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show more
    Last updated: 22 days ago • Promoted
    Senior AI / ML Pipeline Engineer

    Senior AI / ML Pipeline Engineer

    SAIVA AI • Republic Of India, IN
    We are seeking a Senior Machine Learning Engineer to join our team and help shape the future of healthcare technology.In this role, you will design, build, and deploy machine learning systems that ...Show more
    Last updated: 30+ days ago • Promoted
    AI Pipeline Engineer

    AI Pipeline Engineer

    EXIDEUS LLC • Republic Of India, IN
    We’re not building “just another platform.Sales, Medicine, and Psychology.Our MVP is in an advanced stage, the foundation is solid, and we already have a strong core team (Backend, Frontend, Design...Show more
    Last updated: 5 days ago • Promoted
    Azure Data Pipeline Engineer

    Azure Data Pipeline Engineer

    Recro • Republic Of India, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 22 days ago • Promoted
    AI / ML Pipeline Engineer

    AI / ML Pipeline Engineer

    Aura Recruitment Solutions • Republic Of India, IN
    Pay starts from 150,000 INR per Month.We’re hiring on behalf of our client, a fast-growing, AI-first company building cutting-edge AI-native applications that transform complex, real-world data int...Show more
    Last updated: 16 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Impetus • Republic Of India, IN
    Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.Use Python and PySpark / Spark to transform, clean, aggregate and prepare data for an...Show more
    Last updated: 30+ days ago • Promoted
    Ai & Data Analytics Engineer

    Ai & Data Analytics Engineer

    Amphenol • Republic Of India, IN
    We are seeking a highly motivated.This role will play a critical part in modernizing and streamlining our testing processes through automation,. The Analyst will collaborate with auditors and stakeh...Show more
    Last updated: 30+ days ago • Promoted
    AI Data Pipeline Engineer

    AI Data Pipeline Engineer

    Tata Consultancy Services • Republic Of India, IN
    Build and maintain data infrastructure : Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud. Ensure data quality : Clean, transform, and enrich raw da...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    Lara Tech Consulting • India
    This is an urgent requirement – Immediate joiners only.We are looking for a hands-on AI Engineer with strong exposure to. Agentic AI frameworks, LLM pipelines, and Model Context Protocol (MCP).The i...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer II (AI / ML) [T500-21411]

    Data Engineer II (AI / ML) [T500-21411]

    ADM • India
    We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition.We unlock the power of nature to provide nourishing quality of life by transforming crops int...Show more
    Last updated: 3 days ago • Promoted
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turing • India, India
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 21 days ago • Promoted
    AI Data Engineer (AWS / Snowflake)

    AI Data Engineer (AWS / Snowflake)

    Entech • India, India
    AI Data Engineer (AWS / Snowflake).Entech Consulting is supporting our client, an AI-driven company that helps global organizations reduce the cost and time-to-market for promotional assets through i...Show more
    Last updated: 30+ days ago • Promoted
    AI Pipeline Architect

    AI Pipeline Architect

    Impetus • Pune, Republic Of India, IN
    We are looking for a Software Engineer who combines deep data engineering expertise with hands-on experience in Generative AI and Agentic AI system development on AWS Cloud.This role is ideal for s...Show more
    Last updated: 16 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Synechron • Pune, Republic Of India, IN
    Data Engineer (Python, SQL, Snowflake ).At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technol...Show more
    Last updated: 22 days ago • Promoted
    AI / ML Pipeline Engineer

    AI / ML Pipeline Engineer

    Entech • Republic Of India, IN
    AI Data Engineer (AWS / Snowflake).Entech Consulting is supporting our client, an AI-driven company that helps global organizations reduce the cost and time-to-market for promotional assets through i...Show more
    Last updated: 15 days ago • Promoted
    AI Lead Engineer

    AI Lead Engineer

    TekGenio • India, India
    Experience : 5+ Years | Type : Full-Time | Location : WFH.Minimum of 5+ years of experience in AI / ML engineering, data science, or algorithm development. Strong experience in machine learning, deep lea...Show more
    Last updated: 1 day ago • Promoted
    AI Engineer

    AI Engineer

    TechWaves Recruitment • India, India
    Location : Role is remote, however you must be based within a City location in India.Our client who provides world’s leading Agent and Agentic solution platform designed for teams looking to streaml...Show more
    Last updated: 21 days ago • Promoted
    Senior Data & AI Engineer

    Senior Data & AI Engineer

    TBO.COM • India
    Floor Tower C Building No - 5 DLF Epitome Gurgaon Haryana.TBO is a global platform that aims to simplify all buying and selling travel needs of travel partners across the world.The proprietary tech...Show more
    Last updated: 2 days ago • Promoted