Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • ludhiana, India
No longer accepting applications
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • ludhiana, India
10 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • ludhiana, India

    Related jobs
    AI Engineer

    AI Engineer

    NyxaLabs • Ludhiana, India
    We're seeking an exceptional AI Engineer with deep expertise in TensorFlow model training to design and build next-generation AI systems. This role focuses on developing sophisticated machine learni...Show more
    Last updated: 1 hour ago • Promoted • New!
    Sales Engineer

    Sales Engineer

    JK Fenner (India) Ltd • Ludhiana, Punjab, India
    Fenner (India) Limited is looking for a Sales Engineer - Gearbox / Gearmotor - Ludhiana.Fenner (India) Limited is a part of the renowned JK Organization. We have been an undisputed market leader in In...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Programmers.io • ludhiana, punjab, in
    We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Insight Global • ludhiana, punjab, in
    Contract with Insight Global Client.React, React Native, TypeScript.React, React Native, and TypeScript.Deploy containerized solutions using. Ensure high-quality deliverables through.CI / CD pipelines...Show more
    Last updated: 30+ days ago • Promoted
    Business Analytics Fellowship Associate

    Business Analytics Fellowship Associate

    HEProAI • ludhiana, punjab, in
    Business Analytics Fellowship Associate.The Business Analytics Fellowship Associate will participate in a structured, project-based learning program designed to build foundational and intermediate ...Show more
    Last updated: 1 hour ago • Promoted • New!
    Engineering Lead

    Engineering Lead

    Altellect • ludhiana, punjab, in
    Koramangala, Bangalore | 5 Days WFO.Altellect is building the next generation of intelligent, high-growth, product-led ventures — and we’re looking for leaders who can help us shape the future.We a...Show more
    Last updated: 1 hour ago • Promoted • New!
    Integration Analyst - ITX

    Integration Analyst - ITX

    Quadrant IT Services • ludhiana, punjab, in
    Position : Integration Analyst - ITX.Hybrid : 1 week in office every month.EDI mapping, integration, and business process understanding within logistics and supply chain domains.The ideal candidate w...Show more
    Last updated: 15 days ago • Promoted
    Generative AI Engineer (2+ Years Agentic AI Experience)

    Generative AI Engineer (2+ Years Agentic AI Experience)

    Phinite.ai • Ludhiana, India
    We're looking for a Generative AI Engineer who has already built and deployed real Agentic AI systems and wants to push the boundaries of multi-agent workflows. What You’ll Work On You will desig...Show more
    Last updated: 1 hour ago • Promoted • New!
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turing • Ludhiana, India
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 9 days ago • Promoted
    AI Engineer (Data Pipelines & RAG)

    AI Engineer (Data Pipelines & RAG)

    BeGig • Ludhiana, India
    Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
    Last updated: 9 days ago • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • ludhiana, punjab, in
    We offer a vibrant and collaborative work environment, cutting-edge tools and technologies, and ample opportunities for professional growth. Job Title : Azure Data Architect.Experience required : 15+ ...Show more
    Last updated: 16 days ago • Promoted
    Data Analyst

    Data Analyst

    Nonrel Technologies • ludhiana, punjab, in
    Nonrel Technologies is a leading IT software company dedicated to transforming businesses through innovative, scalable, and secure software solutions. We specialize in custom software development, c...Show more
    Last updated: 1 hour ago • Promoted • New!
    AI Engineer (Gen AI, Agentic AI)

    AI Engineer (Gen AI, Agentic AI)

    Chetty Technologies • Ludhiana, India
    Chetty Technologies is a specialized technology company with expertise in delivering advanced consulting services to industries including Banking & Finance, Telecom, Healthcare, and Hospitality.Wit...Show more
    Last updated: 1 hour ago • Promoted • New!
    Data Analyst / Business Analyst

    Data Analyst / Business Analyst

    ACL Digital • ludhiana, punjab, in
    Claims, Member, Provider, Encounter).Skilled in SQL and BI tools (Tableau, Power BI); capable of translating business needs into data and reporting requirements.Show more
    Last updated: 14 days ago • Promoted
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Delphie Consulting services • Ludhiana, India
    Hiring #AI Software Developer #AI / ML #NLP # Implement #AI solutions #Python #AI frameworks #TensorFlow #PyTorch #cloud platforms #Azure #LLMs #RAG systems #Agile #Docker. Job Title : AI Software Dev...Show more
    Last updated: 1 hour ago • Promoted • New!
    Gen AI Lead

    Gen AI Lead

    EXL • Ludhiana, India
    SME for clients : Serve as the primary point of contact for clients in Gen AI needs, including senior executives, to understand their needs and deliver tailored generative AI solutions.Project Lead...Show more
    Last updated: 30+ days ago • Promoted
    Solutions Engineer

    Solutions Engineer

    JK Fenner (India) Ltd • Ludhiāna, Republic Of India, IN
    Fenner (India) Limited is looking for a Sales Engineer - Gearbox / Gearmotor - Ludhiana.Fenner (India) Limited is a part of the renowned JK Organization. We have been an undisputed market leader in In...Show more
    Last updated: 6 days ago • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Recro • ludhiana, punjab, in
    What would you be doing / Expected from this role?.Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.Drive the archite...Show more
    Last updated: 30+ days ago • Promoted