Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • Erode, IN
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • Erode, IN
9 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • Erode, IN

    Related jobs
    AI Engineer

    AI Engineer

    Idea Elan India • Erode, IN
    AI Engineer (2 - 4 Years Experience).Idea Elan LLC is a product based company that provides comprehensive software solutions for. Universities and Institutions worldwide.We are seeking a skilled AI ...Show more
    Last updated: 8 days ago • Promoted
    Data Engineer (DOMO & Python / Kafka)

    Data Engineer (DOMO & Python / Kafka)

    Smart Moves Consultants • erode, tamil nadu, in
    We are looking for candidates with strong Domo and Python / Kafka connect experience.Please find the JD below and share suitable and strong profiles at the earliest. Design, build, and maintain scala...Show more
    Last updated: 21 hours ago • Promoted • New!
    Lead AI Engineer

    Lead AI Engineer

    Genisys Group • Erode, Tamil Nadu, India
    About the Role As an AI / ML Engineer at Genisys Group, you will be instrumental in developing and implementing cutting-edge AI solutions, with a strong focus on Large Language Models (LLMs) and Retr...Show more
    Last updated: 22 days ago • Promoted
    AI Engineer

    AI Engineer

    Asite • Erode, IN
    We start with a simple idea : the built environment should be smarter, safer and more sustainable.Everything we do is about helping the people behind major construction and infrastructure projects w...Show more
    Last updated: 4 days ago • Promoted
    AI Engineer

    AI Engineer

    TechKareer • Erode, IN
    Mumbai / Bengaluru / Gurgaon (Hybrid : 3 days / week in office).Remote option for exceptional candidates.We’re building production-grade AI workflows and agentic applications that power real user expe...Show more
    Last updated: 30+ days ago • Promoted
    AI Data Engineer (AWS / Snowflake)

    AI Data Engineer (AWS / Snowflake)

    Entech • erode, tamil nadu, in
    AI Data Engineer (AWS / Snowflake).Entech Consulting is supporting our client, an AI-driven company that helps global organizations reduce the cost and time-to-market for promotional assets through i...Show more
    Last updated: 30+ days ago • Promoted
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent Partner • Erode, IN
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Erode, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    TechWaves Recruitment • Erode, IN
    Location : Role is remote, however you must be based within a City location in India.Our client who provides world’s leading Agent and Agentic solution platform designed for teams looking to streaml...Show more
    Last updated: 21 days ago • Promoted
    Ai Data Engineer

    Ai Data Engineer

    Entech • Erode, Republic Of India, IN
    AI Data Engineer (AWS / Snowflake).Entech Consulting is supporting our client, an AI-driven company that helps global organizations reduce the cost and time-to-market for promotional assets through i...Show more
    Last updated: 30+ days ago • Promoted
    Ai Data Engineer

    Ai Data Engineer

    Tata Consultancy Services • Erode, Republic Of India, IN
    Build and maintain data infrastructure : Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud. Ensure data quality : Clean, transform, and enrich raw da...Show more
    Last updated: 30+ days ago • Promoted
    AI Lead Engineer

    AI Lead Engineer

    TekGenio • Erode, IN
    Experience : 5+ Years | Type : Full-Time | Location : WFH.Minimum of 5+ years of experience in AI / ML engineering, data science, or algorithm development. Strong experience in machine learning, deep lea...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Aceolution • Erode, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer (AWS)

    AI Engineer (AWS)

    LTIMindtree • erode, tamil nadu, in
    LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by ha...Show more
    Last updated: 11 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Sesheng Company • Erode, IN
    GenAI Engineer (Semantic Search & RAG Systems).Remote in India (to work in US Time zone).You will be instrumental in designing and deploying a cutting-edge semantic search capability to power our n...Show more
    Last updated: 22 days ago • Promoted
    Lead AI Engineer

    Lead AI Engineer

    Blend • Erode, IN
    We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show more
    Last updated: 18 days ago • Promoted
    Sr AI Engineer

    Sr AI Engineer

    Litmus7 • erode, tamil nadu, in
    As part of this initiative, resource should research and experiment with the latest AI and cloud innovations (such as AWS Agents, Databricks AI, and other Model Context Protocol (MCP integrations),...Show more
    Last updated: 22 days ago • Promoted
    AI Data Engineer

    AI Data Engineer

    Tata Consultancy Services • erode, tamil nadu, in
    Build and maintain data infrastructure : Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud. Ensure data quality : Clean, transform, and enrich raw da...Show more
    Last updated: 30+ days ago • Promoted