Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • Delhi, IN
No longer accepting applications
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • Delhi, IN
16 hours ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • Delhi, IN

    Related jobs
    AI Engineer (Data Pipelines & RAG)

    AI Engineer (Data Pipelines & RAG)

    BeGig • Delhi, Delhi, India
    Job Role- AI Engineer (Data Pipelines & RAG) Job Type- Full-time Work Mode- Remote(6 days working) We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powe...Show more
    Last updated: 11 hours ago • Promoted • New!
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent Partner • Ghaziabad, IN
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show more
    Last updated: 13 days ago • Promoted
    Lead AI Engineer

    Lead AI Engineer

    Blend • Ghaziabad, IN
    We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show more
    Last updated: 9 days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Delhi, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    Sutra.AI • Delhi, IN
    Our mission is to help enterprises transform raw data into intelligent, actionable insights through AI, automation, and decision intelligence. The ideal candidate is hands-on, detail-oriented, and t...Show more
    Last updated: 5 days ago • Promoted
    AI Engineer / Senior AI Engineer, India - BCG X

    AI Engineer / Senior AI Engineer, India - BCG X

    Boston Consulting Group • Gurgaon, Haryana, India
    Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy whe...Show more
    Last updated: 1 day ago • Promoted
    AI Data Engineer

    AI Data Engineer

    Peak Trust Global Real Estate • Ghaziabad, IN
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: 16 hours ago • Promoted • New!
    AI Data Engineer (AWS / Snowflake)

    AI Data Engineer (AWS / Snowflake)

    Entech • Ghaziabad, IN
    AI Data Engineer (AWS / Snowflake).Entech Consulting is supporting our client, an AI-driven company that helps global organizations reduce the cost and time-to-market for promotional assets through i...Show more
    Last updated: 27 days ago • Promoted
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turing • Delhi, IN
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 12 days ago • Promoted
    Senior AI Engineer

    Senior AI Engineer

    RED Global • Delhi, IN
    Location in India – Bangalore, Hyderabad, Pune.Hybrid work 2 days onsite per week.Overall 7,8+ years' experience.Please share your CV separately to me at jkhan@redglobal. Including your notice perio...Show more
    Last updated: 24 days ago • Promoted
    Lead AI Engineer

    Lead AI Engineer

    Occams Advisory • New Delhi, Delhi, India
    Serving as a trusted advisor throughout the business lifecycle, Occams combines Fortune 500 expertise, entrepreneurial insights, and a global perspective to deliver world-class solutions.Occams has...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    TechWaves Recruitment • Ghaziabad, IN
    Location : Role is remote, however you must be based within a City location in India.Our client who provides world’s leading Agent and Agentic solution platform designed for teams looking to streaml...Show more
    Last updated: 13 days ago • Promoted
    AI Engineer

    AI Engineer

    Aura Recruitment Solutions • Ghaziabad, IN
    Pay starts from 150,000 INR per Month.We’re hiring on behalf of our client, a fast-growing, AI-first company building cutting-edge AI-native applications that transform complex, real-world data int...Show more
    Last updated: 7 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    BCI~IT • Noida, Uttar Pradesh, India
    BCI is looking for Senior GenAI Engineer / Developer with a strong Python background to join an ongoing project for our direct client in the USA. You will join an offshore team that is growing and t...Show more
    Last updated: 24 days ago • Promoted
    Data Engineer

    Data Engineer

    TEKsystems • Delhi, IN
    Location - Remote or Delhi or Hyderabad or Bangalore or Pune.Proficiency in Python and experience maintaining data-driven applications. Hands-on experience with ETL pipeline development, schema desi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Delhi, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Sesheng Company • Ghaziabad, IN
    GenAI Engineer (Semantic Search & RAG Systems).Remote in India (to work in US Time zone).You will be instrumental in designing and deploying a cutting-edge semantic search capability to power our n...Show more
    Last updated: 13 days ago • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    Luxoft • Delhi, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 10 days ago • Promoted