Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • ludhiana, India
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • ludhiana, India
9 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • ludhiana, India

    Related jobs
    Data Engineer

    Data Engineer

    System Soft Technologies • ludhiana, punjab, in
    Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
    Last updated: 3 days ago • Promoted
    Lead AI / ML Engineer

    Lead AI / ML Engineer

    Simelabs - Digital, AI / ML, Automation, Robotics, Gen AI. • ludhiana, punjab, in
    Architect scalable ML pipelines, services, and platforms using modern cloud and MLOps practices.Build, fine-tune, and integrate Generative AI models (LLMs, Vision Models, Multimodal Models) into bu...Show more
    Last updated: 4 hours ago • Promoted • New!
    Staff AI Engineer – Real-Time Call Intelligence & Private AI Brain (Aonxi)

    Staff AI Engineer – Real-Time Call Intelligence & Private AI Brain (Aonxi)

    Aonxi.Tech • ludhiana, punjab, in
    Aonxi is building the world’s first conversion-backed, credit-embedded revenue operating system - where every call, meeting, and conversation gets transcribed, scored, and turned into sales perform...Show more
    Last updated: 3 days ago • Promoted
    AI Engineer (Gen AI, Agentic AI)

    AI Engineer (Gen AI, Agentic AI)

    Chetty Technologies • ludhiana, punjab, in
    Chetty Technologies is a specialized technology company with expertise in delivering advanced consulting services to industries including Banking & Finance, Telecom, Healthcare, and Hospitality.Wit...Show more
    Last updated: 8 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Staffingine LLC • ludhiana, punjab, in
    The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise...Show more
    Last updated: 4 hours ago • Promoted • New!
    AWS Data Engineer (Remote)

    AWS Data Engineer (Remote)

    Mindcraft Labs • ludhiana, punjab, in
    Remote
    This role focuses on building and maintaining data pipelines and analytics infrastructure on AWS.You will work daily with S3, Glue, Redshift, Athena, Lake Formation, Airflow, SNS / SQS, and Postgres ...Show more
    Last updated: 4 hours ago • Promoted • New!
    GCP Big Data Engineer (Full-time at a Fortune 500 tech MNC )

    GCP Big Data Engineer (Full-time at a Fortune 500 tech MNC )

    HARP • ludhiana, punjab, in
    We are looking for an experienced and motivated.The ideal candidate will have 5 years of relevant experience in data engineering, with a strong focus on. This role requires strong technical expertis...Show more
    Last updated: 30+ days ago • Promoted
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    ACL Digital • ludhiana, punjab, in
    We are Hiring : AI Engineer : Remote Opportunity.Design, develop and deploy scalable.Machine Learning and AI models.Perform data extraction, cleaning, transformation and modeling using.Develop end-to...Show more
    Last updated: 3 days ago • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    Live Connections • ludhiana, punjab, in
    Role - Snowflake Data Engineer.Required Notice Period - Immediate Joiner.To apply, connect with Abhishek via abhishek.Show more
    Last updated: 13 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    telerapp • ludhiana, punjab, in
    As a Gen AI Engineer at Telerapp, you will play a crucial role in designing, developing, and implementing cutting-edge generative artificial intelligence models and systems.Your expertise will cont...Show more
    Last updated: 3 days ago • Promoted
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turing • ludhiana, punjab, in
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 22 days ago • Promoted
    Ai Data Engineer - 17852

    Ai Data Engineer - 17852

    Turing • Ludhiāna, Republic Of India, IN
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 21 days ago • Promoted
    AI Engineer

    AI Engineer

    NyxaLabs • ludhiana, India
    We're seeking an exceptional AI Engineer with deep expertise in TensorFlow model training to design and build next-generation AI systems. This role focuses on developing sophisticated machine learni...Show more
    Last updated: 3 hours ago • Promoted • New!
    No‑code AI Automation Engineer - 300,000 INR / month - (n8n + Bubble, Webflow a plus)

    No‑code AI Automation Engineer - 300,000 INR / month - (n8n + Bubble, Webflow a plus)

    OpenTrain AI • ludhiana, punjab, in
    No‑code AI Automation Engineer (n8n or Make or Zapier + Bubble, Webflow a plus).OpenTrain works with large AI companies to provide the. We design workflows, tools, and teams so that AI systems can l...Show more
    Last updated: 1 day ago • Promoted
    Agentic & AI Tech Ops Engineer

    Agentic & AI Tech Ops Engineer

    Insight Global • ludhiana, punjab, in
    Agentic & AI Tech Ops Engineer.Agentic & AI Tech Ops Engineer.AI and Agentic AI systems in production.You will manage deployments, monitor performance, troubleshoot issues, and implement best pract...Show more
    Last updated: 4 hours ago • Promoted • New!
    Ai Engineer

    Ai Engineer

    BeGig • Ludhiāna, Republic Of India, IN
    Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
    Last updated: 9 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Arenema • ludhiana, punjab, in
    India (remote – Bangalore / Karnataka area preferred).Full-time contractor / employee.You will be a core member of the team building a data platform that maps economic, advertising and real-estate ac...Show more
    Last updated: 4 hours ago • Promoted • New!
    Data Engineer(Intern)

    Data Engineer(Intern)

    Tech Phoenix • ludhiana, punjab, in
    Tech Phoenix is a data science and AI startup that delivers cutting-edge solutions to clients across industries.We take on challenging projects ranging from advanced analytics and machine learning ...Show more
    Last updated: 2 days ago • Promoted