Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • ludhiana, India
No longer accepting applications
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • ludhiana, India
8 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • ludhiana, India

    Related jobs
    Generative AI Engineer

    Generative AI Engineer

    Sesheng Company • ludhiana, punjab, in
    GenAI Engineer (Semantic Search & RAG Systems).Remote in India (to work in US Time zone).You will be instrumental in designing and deploying a cutting-edge semantic search capability to power our n...Show more
    Last updated: 21 days ago • Promoted
    Senior Python / / AI Engineer

    Senior Python / / AI Engineer

    Luxoft • ludhiana, punjab, in
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 7 hours ago • Promoted • New!
    GCP Data Engineer

    GCP Data Engineer

    Xsell Resources • ludhiana, punjab, in
    Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show more
    Last updated: 20 days ago • Promoted
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Tata Consultancy Services • ludhiana, punjab, in
    TCS is conducting virtual drive Engineer.Years of Experience : 5 to 10 Yrs.Mode of Interview : Virtual Mode.Date of Interview : 5th, 6th, 7th Nov, 2025. Python, Generative AI models (LLMs, Image Genera...Show more
    Last updated: 30+ days ago • Promoted
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Ascendion • ludhiana, punjab, in
    Job Title : : Python Artificial Engineer.Minimum relevant experience : : 6.We are seeking a highly motivated AI Engineer with hands-on experience in developing and deploying agentic AI architectures....Show more
    Last updated: 18 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Capgemini • ludhiana, punjab, in
    Experience with NLP And Machine Learning.Understanding RAG, AI / ML Concepts.Experience Google Vertex AI, Langchain.Show more
    Last updated: 10 days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • ludhiana, punjab, in
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 13 days ago • Promoted
    AI Engineer

    AI Engineer

    MightyBot • ludhiana, punjab, in
    Join our team as an AI Engineer, where we're focused on graduating AI from interesting demos to indispensable products.You will build reliable, self-improving systems that empower subject matter ex...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (DOMO & Python / Kafka)

    Data Engineer (DOMO & Python / Kafka)

    Smart Moves Consultants • ludhiana, punjab, in
    We are looking for candidates with strong Domo and Python / Kafka connect experience.Please find the JD below and share suitable and strong profiles at the earliest. Design, build, and maintain scala...Show more
    Last updated: 7 hours ago • Promoted • New!
    Senior AI Engineer

    Senior AI Engineer

    BeGig • ludhiana, punjab, in
    We are looking for an experienced.The ideal candidate should be proficient in FastAPI, Python, LangChain, and modern AI application design. You will be responsible for designing, developing, and dep...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • ludhiana, punjab, in
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Philodesign Technologies Inc • ludhiana, punjab, in
    Gen AI Engineer | Remote | 4+ Years Experience | Budget : 1 LPM.We are looking for an experienced.GenAI solutions for global clients. If you have a solid background in AI / ML engineering and have deli...Show more
    Last updated: 15 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Turing • ludhiana, punjab, in
    Turing is looking for people with LLM experience to join us in solving business problems for our Fortune 500 customers.You will be a key member of the Turing GenAI delivery organization and part of...Show more
    Last updated: 18 days ago • Promoted
    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    AIMLEAP • ludhiana, punjab, in
    Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • ludhiana, punjab, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    TechKareer • ludhiana, punjab, in
    Mumbai / Bengaluru / Gurgaon (Hybrid : 3 days / week in office).Remote option for exceptional candidates.We’re building production-grade AI workflows and agentic applications that power real user expe...Show more
    Last updated: 30+ days ago • Promoted
    AI Lead Engineer

    AI Lead Engineer

    TekGenio • ludhiana, punjab, in
    Experience : 5+ Years | Type : Full-Time | Location : WFH.Minimum of 5+ years of experience in AI / ML engineering, data science, or algorithm development. Strong experience in machine learning, deep lea...Show more
    Last updated: 7 hours ago • Promoted • New!
    PySpark Data Engineer

    PySpark Data Engineer

    EXTRAGIG • ludhiana, punjab, in
    Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role. Execute creative software and data solutions, including des...Show more
    Last updated: 30+ days ago • Promoted