Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • vizianagaram, India
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • vizianagaram, India
10 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • vizianagaram, India

    Related jobs
    Data AI / ML Enigneer

    Data AI / ML Enigneer

    Confidential • India, Bheemunipatnam
    AI-driven solutions from the ground up.You'll be part of a fast-growing team focused on developing intelligent systems, data pipelines, and machine learning models that solve real-world problems.Wo...Show more
    Last updated: 17 days ago • Promoted
    AI Engineer Intern

    AI Engineer Intern

    Qureal AI • vizianagaram, andhra pradesh, in
    Hiring : AI Engineer Intern (Remote + Paid).We are looking for a dedicated AI Engineer Intern.This role offers a real opportunity to transition into a full-time position based on performance.PPO / F...Show more
    Last updated: 1 hour ago • Promoted • New!
    AI tester / experimentation engineer

    AI tester / experimentation engineer

    People Prime Worldwide • vizianagaram, andhra pradesh, in
    Our client is a trusted global innovator of IT and business services.They help clients transform through consulting, industry solutions, business process services, digital & IT modernization and ma...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Primesoft Inc • vizianagaram, andhra pradesh, in
    Primesoft Enterprise IT Services Pvt.As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learnin...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer Intern

    AI Engineer Intern

    Signet Arms • vizianagaram, andhra pradesh, in
    Signet Arms is an innovative defense technology company.We are building next-generation agentic AI systems, enabling autonomous reasoning, workflow orchestration, and intelligent automation.Our wor...Show more
    Last updated: 1 hour ago • Promoted • New!
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • vizianagaram, andhra pradesh, in
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred. ML / Data Science with a focus on generative AI, LLMs, or co...Show more
    Last updated: 16 days ago • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    Leading MNC • vizianagaram, andhra pradesh, in
    Looking for a Freelance Data Engineer to join a team of rockstar developers.The candidate should have a minimum of 8+ yrs. If you're looking for freelance / part time opportunity (along with your day...Show more
    Last updated: 13 days ago • Promoted
    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    Peak Trust Global Real Estate • vizianagaram, andhra pradesh, in
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: 1 hour ago • Promoted • New!
    AI Python Engineer

    AI Python Engineer

    SolarSys Innovations Private Ltd • vizianagaram, India
    AI Engineer (Backend) – Python.Design and develop Python backend services using FastAPI FastAPI for AI-powered.Implement agentic workflows using LangChain LangChain and / or Azure AI agentic.AutoGen ...Show more
    Last updated: 1 hour ago • Promoted • New!
    Generative AI Engineer

    Generative AI Engineer

    Turing • vizianagaram, India
    Turing is looking for people with LLM experience to join us in solving business problems for our Fortune 500 customers.You will be a key member of the Turing GenAI delivery organization and part of...Show more
    Last updated: 19 days ago • Promoted
    Generative Ai Engineer

    Generative Ai Engineer

    Turing • Vizianagaram, Republic Of India, IN
    Turing is looking for people with LLM experience to join us in solving business problems for our Fortune 500 customers.You will be a key member of the Turing GenAI delivery organization and part of...Show more
    Last updated: 20 days ago • Promoted
    Ai Python Engineer

    Ai Python Engineer

    SolarSys Innovations Private Ltd • Vizianagaram, Republic Of India, IN
    AI Engineer (Backend) – Python.Design and develop Python backend services using FastAPI FastAPI for AI-powered.Implement agentic workflows using LangChain LangChain and / or Azure AI agentic.AutoGen ...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    N53 Tech • vizianagaram, andhra pradesh, in
    Our client is expanding their Data Engineering function and hiring across multiple levels (3 to 10 years).You will help build and scale their data architecture, data pipelines, data platform govern...Show more
    Last updated: 1 hour ago • Promoted • New!
    Data Engineer

    Data Engineer

    Grantify • vizianagaram, andhra pradesh, in
    Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirat...Show more
    Last updated: 1 hour ago • Promoted • New!
    AI Engineer

    AI Engineer

    Recruin • vizianagaram, andhra pradesh, in
    Our Client is a global leader in diversified electronics for the semiconductor manufacturing ecosystem.Virtually every electronic device in the world is produced using our technologies.No laptop, s...Show more
    Last updated: 1 hour ago • Promoted • New!
    Python Developer

    Python Developer

    TekXera • vizianagaram, andhra pradesh, in
    Senior Python Engineer – Service Implementation.India | Pakistan | Nigeria | Kenya | Egypt | Ghana | Bangladesh | Turkey | Mexico. Full-Time Contract (9 Months, Extendable).San Francisco–based AI re...Show more
    Last updated: 1 hour ago • Promoted • New!
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turing • Vizianagaram, Andhra Pradesh, India
    Role Overview : We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve...Show more
    Last updated: 22 days ago • Promoted
    AI Architect

    AI Architect

    TekPillar® • vizianagaram, andhra pradesh, in
    Cloud platforms (AWS or equivalent).Artificial Intelligence / Large Language Models (LLMs).Architect and design a scalable and robust agentic AI platform for automotive domains.Evaluate and impleme...Show more
    Last updated: 1 hour ago • Promoted • New!