Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • Kolkata, IN
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • Kolkata, IN
7 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • Kolkata, IN

    Related jobs
    AI Engineer

    AI Engineer

    MightyBot • Kolkata, IN
    Join our team as an AI Engineer, where we're focused on graduating AI from interesting demos to indispensable products.You will build reliable, self-improving systems that empower subject matter ex...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Sesheng Company • Kolkata, IN
    GenAI Engineer (Semantic Search & RAG Systems).Remote in India (to work in US Time zone).You will be instrumental in designing and deploying a cutting-edge semantic search capability to power our n...Show more
    Last updated: 20 days ago • Promoted
    AI Engineer

    AI Engineer

    Aura Recruitment Solutions • Kolkata, IN
    Pay starts from 150,000 INR per Month.We’re hiring on behalf of our client, a fast-growing, AI-first company building cutting-edge AI-native applications that transform complex, real-world data int...Show more
    Last updated: 14 days ago • Promoted
    Gen AI Engineer

    Gen AI Engineer

    LTIMindtree • Greater Kolkata Area, India
    Notice Period : Immediate to 30 days.Years of experience in architecture design and development of various applications using cloudnative digital technologies in the insurance.Knowledge of Agentic A...Show more
    Last updated: 2 days ago • Promoted
    AI Engineer

    AI Engineer

    TechWaves Recruitment • Kolkata, IN
    Location : Role is remote, however you must be based within a City location in India.Our client who provides world’s leading Agent and Agentic solution platform designed for teams looking to streaml...Show more
    Last updated: 20 days ago • Promoted
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent Partner • Kolkata, IN
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show more
    Last updated: 20 days ago • Promoted
    AI Engineer

    AI Engineer

    Idea Elan India • Kolkata, IN
    AI Engineer (2 - 4 Years Experience).Idea Elan LLC is a product based company that provides comprehensive software solutions for. Universities and Institutions worldwide.We are seeking a skilled AI ...Show more
    Last updated: 6 days ago • Promoted
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turing • Kolkata, West Bengal, India
    Role Overview : We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improv...Show more
    Last updated: 19 days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Kolkata, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    TechKareer • Kolkata, IN
    Mumbai / Bengaluru / Gurgaon (Hybrid : 3 days / week in office).Remote option for exceptional candidates.We’re building production-grade AI workflows and agentic applications that power real user expe...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    Uplevyl • Kolkata, IN
    Through our AI-powered agents, we’re building scalable, agentic community systems that reduce manual work and increase member engagement—especially for women-centric organizations.Someone who under...Show more
    Last updated: 10 hours ago • Promoted • New!
    Generative AI Engineer

    Generative AI Engineer

    LTIMindtree • Kolkata, West Bengal, India
    We're Hiring : Data Scientist / GenAI Engineer (5–12 Years Experience).Location : Pan India | 💼 Employment Type : Full-Time | 🌐 Hybrid options available. Are you passionate about solving real-world p...Show more
    Last updated: 14 days ago • Promoted
    Senior AI Engineer

    Senior AI Engineer

    BeGig • Kolkata, IN
    We are looking for an experienced.The ideal candidate should be proficient in FastAPI, Python, LangChain, and modern AI application design. You will be responsible for designing, developing, and dep...Show more
    Last updated: 10 hours ago • Promoted • New!
    AWS Data Engineer

    AWS Data Engineer

    People Prime Worldwide • Kolkata, IN
    Data Engineer (L4) – Python & AWS.We are looking for a Senior Data Engineer with strong expertise in.You will design and build scalable data pipelines, manage cloud-based data platforms, ensure dat...Show more
    Last updated: 4 days ago • Promoted
    Lead AI Engineer

    Lead AI Engineer

    Blend • Kolkata, IN
    We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show more
    Last updated: 16 days ago • Promoted
    Data Engineer

    Data Engineer

    Aceolution • Kolkata, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    Luxoft • Kolkata, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 17 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Kolkata, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted