Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • amritsar, India
No longer accepting applications
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • amritsar, India
10 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • amritsar, India

    Related jobs
    Azure Data Engineer

    Azure Data Engineer

    Tech Mahindra • Amritsar, Punjab, India
    Job Description : •4 to 15 years' experience in Data Engineering environmentWe have opening for Azure data engineer , azure data lead , Azure data Architect •Expertise in CI-CD, Pyspark, SQL •Expertis...Show more
    Last updated: 1 hour ago • Promoted • New!
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Delphie Consulting services • Amritsar, Punjab, India
    Hiring #AI Software Developer #AI / ML #NLP # Implement #AI solutions #Python #AI frameworks #TensorFlow #PyTorch #cloud platforms #Azure #LLMs #RAG systems #Agile #DockerJob Title : AI Software Deve...Show more
    Last updated: 1 hour ago • Promoted • New!
    AI Engineer

    AI Engineer

    NyxaLabs • Amritsar, Punjab, India
    We're seeking an exceptional AI Engineer with deep expertise in TensorFlow model training to design and build next-generation AI systems. This role focuses on developing sophisticated machine learni...Show more
    Last updated: 1 hour ago • Promoted • New!
    Data Engineer(Intern)

    Data Engineer(Intern)

    Tech Phoenix • Amritsar, Punjab, India
    Company DescriptionTech Phoenix is a dynamic platform dedicated to all things technology, offering the latest news, trends, and insights from the tech industry. Whether you are a tech enthusiast or ...Show more
    Last updated: 23 hours ago • Promoted
    AI Python Engineer

    AI Python Engineer

    SolarSys Innovations Private Ltd • amritsar, punjab, in
    AI Engineer (Backend) – Python.Design and develop Python backend services using FastAPI FastAPI for AI-powered.Implement agentic workflows using LangChain LangChain and / or Azure AI agentic.AutoGen ...Show more
    Last updated: 1 hour ago • Promoted • New!
    Gen AI Lead

    Gen AI Lead

    EXL • Amritsar, Punjab, India
    Locations : Bangalore / GurgaonRole and Responsibilities : SME for clients : Serve as the primary point of contact for clients in Gen AI needs, including senior executives, to understand their needs an...Show more
    Last updated: 1 hour ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    Confidential • Amritsar, India
    Confidential (based on experience).Note : This is a requirement for one of Uplers' client - Forbes Advisor).What do you need for this opportunity. Google Cloud, DPT, marketing data.Forbes Advisor is ...Show more
    Last updated: 15 days ago • Promoted
    No‑code AI Automation Engineer - 300,000 INR / month - (n8n + Bubble, Webflow a plus)

    No‑code AI Automation Engineer - 300,000 INR / month - (n8n + Bubble, Webflow a plus)

    OpenTrain AI • Amritsar, Punjab, India
    Title : No‑code AI Automation Engineer (n8n or Make or Zapier + Bubble, Webflow a plus)Company : OpenTrainLocation : Remote in IndiaEmployment type : Full timeCompensation : Up to ₹300,000 per mon...Show more
    Last updated: 1 hour ago • Promoted • New!
    Data Analyst

    Data Analyst

    Nonrel Technologies • amritsar, punjab, in
    Nonrel Technologies is a leading IT software company dedicated to transforming businesses through innovative, scalable, and secure software solutions. We specialize in custom software development, c...Show more
    Last updated: 5 hours ago • Promoted • New!
    Machine Learning Engineer

    Machine Learning Engineer

    Recro • amritsar, punjab, in
    What would you be doing / Expected from this role?.Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.Drive the archite...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI Engineer (2+ Years Agentic AI Experience)

    Generative AI Engineer (2+ Years Agentic AI Experience)

    Phinite.ai • Amritsar, Punjab, India
    We're looking for a Generative AI Engineer who has already built and deployed real Agentic AI systems and wants to push the boundaries of multi-agent workflows. What You’ll Work On You will desig...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Software Engineer

    Senior Software Engineer

    Programmers.io • amritsar, punjab, in
    We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show more
    Last updated: 30+ days ago • Promoted
    Application Support Engineer / Full Stack (Python + typescript) Support Engineer - Remote Work

    Application Support Engineer / Full Stack (Python + typescript) Support Engineer - Remote Work

    techolution • amritsar, punjab, in
    Remote
    Sev1 / Sev2) and contributing to application development.This hybrid role requires strong expertise in Python, TypeScript, AWS services, CI / CD pipelines, and monitoring tools.The ideal candidate shou...Show more
    Last updated: 1 hour ago • Promoted • New!
    Business Analytics Fellowship Associate

    Business Analytics Fellowship Associate

    HEProAI • amritsar, punjab, in
    Business Analytics Fellowship Associate.The Business Analytics Fellowship Associate will participate in a structured, project-based learning program designed to build foundational and intermediate ...Show more
    Last updated: 5 hours ago • Promoted • New!
    Data Analyst / Business Analyst

    Data Analyst / Business Analyst

    ACL Digital • amritsar, punjab, in
    Data Analyst / Business Analyst.Strong working knowledge of healthcare domains such as.Claims, Member, Provider, and Encounter data. Strong analytical skills with the ability to interpret data, iden...Show more
    Last updated: 14 days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Insight Global • amritsar, punjab, in
    Contract with Insight Global Client.React, React Native, TypeScript.React, React Native, and TypeScript.Deploy containerized solutions using. Ensure high-quality deliverables through.CI / CD pipelines...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer (Backend) - Python

    AI Engineer (Backend) - Python

    Confidential • Amritsar, India
    Confidential (based on experience).Note : This is a requirement for one of Uplers' client - Xpergia).What do you need for this opportunity. AI Engineer, Python, FastAPI, AWS Bedrock, Azure AI Foundry...Show more
    Last updated: 8 days ago • Promoted
    Azure Databricks Engineer

    Azure Databricks Engineer

    Philodesign Technologies Inc • Amritsar, Punjab, India
    Job Opening : Azure Databricks Engineer (7+ Years Experience) | Budget : ₹1 LPM | Remote / HybridInterview Process : 3 RoundsBGV : MandatoryWe are seeking a highly skilled Azure Databricks Engineer w...Show more
    Last updated: 1 hour ago • Promoted • New!