Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • vijayapura, rajasthan, in
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • vijayapura, rajasthan, in
7 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • vijayapura, rajasthan, in

    Related jobs
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent Partner • vijayapura, rajasthan, in
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show more
    Last updated: 20 days ago • Promoted
    Sr AI Engineer

    Sr AI Engineer

    Litmus7 • vijayapura, rajasthan, in
    As part of this initiative, resource should research and experiment with the latest AI and cloud innovations (such as AWS Agents, Databricks AI, and other Model Context Protocol (MCP integrations),...Show more
    Last updated: 20 days ago • Promoted
    AI Engineer

    AI Engineer

    MightyBot • vijayapura, rajasthan, in
    Join our team as an AI Engineer, where we're focused on graduating AI from interesting demos to indispensable products.You will build reliable, self-improving systems that empower subject matter ex...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Turing • vijayapura, rajasthan, in
    Turing is looking for people with LLM experience to join us in solving business problems for our Fortune 500 customers.You will be a key member of the Turing GenAI delivery organization and part of...Show more
    Last updated: 17 days ago • Promoted
    AI Engineer

    AI Engineer

    TechKareer • vijayapura, rajasthan, in
    Mumbai / Bengaluru / Gurgaon (Hybrid : 3 days / week in office).Remote option for exceptional candidates.We’re building production-grade AI workflows and agentic applications that power real user expe...Show more
    Last updated: 30+ days ago • Promoted
    Databricks Data Architect

    Databricks Data Architect

    Tata Consultancy Services • vijayapura, rajasthan, in
    Experience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e. Docker, Kubernetes) for deploying data workflows.Should be able ...Show more
    Last updated: 20 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • vijayapura, rajasthan, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show more
    Last updated: 29 days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • vijayapura, rajasthan, in
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Ascendion • vijayapura, rajasthan, in
    Job Title : : Python Artificial Engineer.Minimum relevant experience : : 6.We are seeking a highly motivated AI Engineer with hands-on experience in developing and deploying agentic AI architectures....Show more
    Last updated: 17 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • vijayapura, rajasthan, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Capgemini • vijayapura, rajasthan, in
    Experience with NLP And Machine Learning.Understanding RAG, AI / ML Concepts.Experience Google Vertex AI, Langchain.Show more
    Last updated: 9 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Xsell Resources • vijayapura, rajasthan, in
    Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show more
    Last updated: 19 days ago • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • vijayapura, rajasthan, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 7 days ago • Promoted
    AI Platform Engineer

    AI Platform Engineer

    Antriksh Cloud Private Limited • vijayapura, rajasthan, in
    Antriksh Cloud Private Limited is a leader in sustainable AI infrastructure, specializing in eco-efficient GPU data centers powered by hydroelectric energy. We enable global AI innovation with scala...Show more
    Last updated: 2 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • vijayapura, rajasthan, in
    Interview Date : Weekend Virtual Drive 15-Nov-25.Extensive coding experience (3+ years) including Python / Pyspark (1 years +). Experience developing in Azure with key data technologies (e.ADLS, ADF, A...Show more
    Last updated: 30+ days ago • Promoted
    Bioinformatics Data Engineer

    Bioinformatics Data Engineer

    Vista Applied Solutions Group Inc • vijayapura, rajasthan, in
    Client is looking for Bioinformatics Data Engineer and this is remote position from India.Build acquisition pipelines from systems including Oracle, SAP, and SQL databases.Transform data to support...Show more
    Last updated: 14 hours ago • Promoted • New!
    Senior AI Engineer

    Senior AI Engineer

    BeGig • vijayapura, rajasthan, in
    We are looking for an experienced.The ideal candidate should be proficient in FastAPI, Python, LangChain, and modern AI application design. You will be responsible for designing, developing, and dep...Show more
    Last updated: 14 hours ago • Promoted • New!
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Tata Consultancy Services • vijayapura, rajasthan, in
    Job Title : Artificial Intelligence Engineer.Required Skillset : Senior Full Stack & AI Engineer (AWS | Node.Location : Delhi / Bangalore / Hyderabad / Pune / Mumbai. We are looking for an experienced.Seni...Show more
    Last updated: 30+ days ago • Promoted