Talent.com
AI Engineer (Data Pipelines & RAG)
AI Engineer (Data Pipelines & RAG)BeGig • hyderabad, telangana, in
No longer accepting applications
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGig • hyderabad, telangana, in
9 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • hyderabad, telangana, in

    Related jobs
    AI Engineer

    AI Engineer

    Intellectt Inc • Hyderabad, Telangana, India
    The ideal candidate will design, build, and deploy intelligent, scalable AI applications that leverage.OpenAI, Anthropic, Gemini, or Llama APIs. Retrieval-Augmented Generation (RAG).FAISS, Pinecone)...Show more
    Last updated: 13 days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Multiscale Technologies India • Hyderabad, Republic Of India, IN
    Data Engineer, Forward Deployed Applications.Location : Hyderabad, India (on-site at client location).Role Type : Individual Contributor. We are hiring a Data Engineer to build reliable data pipelines...Show more
    Last updated: 19 days ago • Promoted
    AI Engineer

    AI Engineer

    TechWaves Recruitment • Hyderabad, IN
    Location : Role is remote, however you must be based within a City location in India.Our client who provides world’s leading Agent and Agentic solution platform designed for teams looking to streaml...Show more
    Last updated: 22 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    HCLTech • Hyderabad, Republic Of India, IN
    Data Engineer - Databricks Job Description.The Data Engineer - Databricks will be responsible for building and optimizing our data pipelines, architectures, and data sets.He will work closely with ...Show more
    Last updated: 15 days ago • Promoted
    Lead Data Pipeline Architect

    Lead Data Pipeline Architect

    EXL • Hyderabad, Republic Of India, IN
    AWS (S3, Redshift, Glue, EMR, Lambda, Kinesis, Athena).Collaborate with data scientists, analysts, and stakeholders to deliver reliable and scalable data solutions. Ensure high availability, scalabi...Show more
    Last updated: 15 days ago • Promoted
    Databricks Gen AI Engineer

    Databricks Gen AI Engineer

    Syren • Hyderabad, Telangana, India
    Model Serving, Vector Search, and embedding workflows.Clustering, Unity Catalog, Delta Lake).OpenAI / Azure OpenAI), and GenAI app patterns (RAG / Agents). Proficiency in SQL, Spark performance tuning...Show more
    Last updated: 4 days ago • Promoted
    AI Engineer

    AI Engineer

    Idea Elan India • hyderabad, telangana, in
    AI Engineer (2 - 4 Years Experience).Idea Elan LLC is a product based company that provides comprehensive software solutions for. Universities and Institutions worldwide.We are seeking a skilled AI ...Show more
    Last updated: 8 days ago • Promoted
    AI Data Engineer

    AI Data Engineer

    Tata Consultancy Services • hyderabad, telangana, in
    Build and maintain data infrastructure : Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud. Ensure data quality : Clean, transform, and enrich raw da...Show more
    Last updated: 30+ days ago • Promoted
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent Partner • hyderabad, telangana, in
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show more
    Last updated: 22 days ago • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    Prudent Technologies and Consulting, Inc. • Hyderabad, Republic Of India, IN
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    People Tech Group Inc • Hyderabad, Republic Of India, IN
    We are seeking a highly skilled Senior Data Engineer with 5+ years of experience in data engineering and migration projects. The ideal candidate will have strong expertise in SQL, Python, data model...Show more
    Last updated: 30+ days ago • Promoted
    AI Data Pipeline Engineer

    AI Data Pipeline Engineer

    People Tech Group Inc • Hyderabad, Republic Of India, IN
    Job Description : Semantic Data & AI Fellowship.Hiring – Full Time | Hyderabad Location.We are looking for skilled and enthusiastic professionals to join our growing team at People Tech Group.If you...Show more
    Last updated: 22 days ago • Promoted
    AI Engineer

    AI Engineer

    Asite • Hyderabad, IN
    We start with a simple idea : the built environment should be smarter, safer and more sustainable.Everything we do is about helping the people behind major construction and infrastructure projects w...Show more
    Last updated: 4 days ago • Promoted
    AI Lead Engineer

    AI Lead Engineer

    TekGenio • Hyderabad, IN
    Experience : 5+ Years | Type : Full-Time | Location : WFH.Minimum of 5+ years of experience in AI / ML engineering, data science, or algorithm development. Strong experience in machine learning, deep lea...Show more
    Last updated: 1 day ago • Promoted
    AI Data Engineer (AWS / Snowflake)

    AI Data Engineer (AWS / Snowflake)

    Entech • Hyderabad, IN
    AI Data Engineer (AWS / Snowflake).Entech Consulting is supporting our client, an AI-driven company that helps global organizations reduce the cost and time-to-market for promotional assets through i...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    Role : Azure Data Engineer – Databricks, DBT.Required Technical Skill Set : Data Lake architecture, Azure Services – ADLS, ADF, Azure Databricks, Synapse. Build the solution for optimal extraction, ...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    Aura Recruitment Solutions • Secunderabad, Telangana, India
    Job Benefits : Title - AI Engineer Location - Remote Pay starts from 150,000 INR per Month Type - Full-time We’re hiring on behalf of our client, a fast-growing, AI-first company building cuttin...Show more
    Last updated: 15 days ago • Promoted
    AI Engineer (AWS)

    AI Engineer (AWS)

    LTIMindtree • secunderabad, telangana, in
    LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by ha...Show more
    Last updated: 12 days ago • Promoted