Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • India, India
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • India, India
8 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • India, India

    Related jobs
    Senior AI / ML Pipeline Engineer

    Senior AI / ML Pipeline Engineer

    SAIVA AI • Republic Of India, IN
    We are seeking a Senior Machine Learning Engineer to join our team and help shape the future of healthcare technology.In this role, you will design, build, and deploy machine learning systems that ...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Baazi Games • New Delhi, Republic Of India, IN
    Reports To : Engineering Manager – Data Platform.The Data Engineer III will lead the design and optimization of Baazi’s large-scale data platform. You’ll architect end-to-end data solutions, mentor j...Show more
    Last updated: 13 days ago • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    MyData Insights Pvt Ltd • Republic Of India, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
    Last updated: 4 days ago • Promoted
    Azure Data Pipeline Engineer

    Azure Data Pipeline Engineer

    Recro • Republic Of India, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 22 days ago • Promoted
    AI / ML Pipeline Engineer

    AI / ML Pipeline Engineer

    Aura Recruitment Solutions • Republic Of India, IN
    Pay starts from 150,000 INR per Month.We’re hiring on behalf of our client, a fast-growing, AI-first company building cutting-edge AI-native applications that transform complex, real-world data int...Show more
    Last updated: 15 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Tata Consultancy Services • Chennai, Republic Of India, IN
    Pyspark and Azure Synapse Analytics / Azure Databricks.Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources.Good experience in SQL or...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    IntraEdge • Republic Of India, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    Ai Data Engineer

    Ai Data Engineer

    Tata Consultancy Services • Republic Of India, IN
    Build and maintain data infrastructure : Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud. Ensure data quality : Clean, transform, and enrich raw da...Show more
    Last updated: 30+ days ago • Promoted
    Ai & Data Analytics Engineer

    Ai & Data Analytics Engineer

    Amphenol • Republic Of India, IN
    We are seeking a highly motivated.This role will play a critical part in modernizing and streamlining our testing processes through automation,. The Analyst will collaborate with auditors and stakeh...Show more
    Last updated: 30+ days ago • Promoted
    AI Data Engineer (AWS / Snowflake)

    AI Data Engineer (AWS / Snowflake)

    Entech • India, India, India
    AI Data Engineer (AWS / Snowflake).Entech Consulting is supporting our client, an AI-driven company that helps global organizations reduce the cost and time-to-market for promotional assets through i...Show more
    Last updated: 29 days ago • Promoted
    AI Data Pipeline Engineer

    AI Data Pipeline Engineer

    Tata Consultancy Services • Republic Of India, IN
    Build and maintain data infrastructure : Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud. Ensure data quality : Clean, transform, and enrich raw da...Show more
    Last updated: 30+ days ago • Promoted
    AI and Databricks Engineer

    AI and Databricks Engineer

    Quantum Integrators • India
    Please find the detailed Job Description below : .Strong experience developing industry grade LLM and Gen-AI applications using OpenAI, Anthropic (Claude), or other major providers.Hands-on experienc...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer II (AI / ML) [T500-21411]

    Data Engineer II (AI / ML) [T500-21411]

    ADM • India
    We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition.We unlock the power of nature to provide nourishing quality of life by transforming crops int...Show more
    Last updated: 2 days ago • Promoted
    Data Science & AI Engineer

    Data Science & AI Engineer

    Tata Consultancy Services • Chennai, Republic Of India, IN
    Required Skills : Data Science, AI, ML, Pyspark.Location : Chennai, Kolkata, Hyderabad, Bangalore, Pune, Delhi.Interview Type : Weekday Virtual Drive.Show more
    Last updated: 15 days ago • Promoted
    AI / ML Pipeline Engineer

    AI / ML Pipeline Engineer

    Entech • Republic Of India, IN
    AI Data Engineer (AWS / Snowflake).Entech Consulting is supporting our client, an AI-driven company that helps global organizations reduce the cost and time-to-market for promotional assets through i...Show more
    Last updated: 14 days ago • Promoted
    AI & Data Analytics Engineer

    AI & Data Analytics Engineer

    Amphenol • India
    We are seeking a highly motivated.This role will play a critical part in modernizing and streamlining our testing processes through automation,. The Analyst will collaborate with auditors and stakeh...Show more
    Last updated: 2 days ago • Promoted
    Lead AI Data Engineer

    Lead AI Data Engineer

    CloudFronts - AI First Microsoft Solutions Partner • Republic Of India, IN
    AI & Data Architect will lead all aspects of AI, Business Intelligence, and Data Architecture with expertise in Azure services, including AI / ML solutions, data engineering, and analytics.The role i...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data & AI Engineer

    Senior Data & AI Engineer

    TBO.COM • India
    Floor Tower C Building No - 5 DLF Epitome Gurgaon Haryana.TBO is a global platform that aims to simplify all buying and selling travel needs of travel partners across the world.The proprietary tech...Show more
    Last updated: 1 day ago • Promoted