AI Data Engineer

Job Details

Job Title : Senior Data Engineer

Location :

Bengalore , chennai, Hyderabad , Pune

Experience : 6–10 Years

Job Type : Full-Time

About the Opportunity

We are looking for a highly experienced

Senior Data Engineer

with strong expertise in Python, Azure cloud, CI / CD pipelines, and modern data engineering frameworks. The ideal candidate will design, build, and optimize scalable data pipelines while integrating AI / LLM capabilities into enterprise workflows.

Mandatory Skills & Expertise

• 6–10 years of hands-on experience in Data Engineering
• Strong expertise in

Python , APIs, ETL / ELT, and automation

Azure

data services (ADF, Databricks, SQL, etc.)

Jenkins, GitLab CI / CD, Azure DevOps

containerization & deployment

(Docker, Kubernetes)

data pipelines

& cloud data architectures

SQL & NoSQL

databases

Key Responsibilities

Develop scalable data pipelines using Python & Azure stack

Implement

AI / LLM workflows , including RAG, LangChain, LangGraph, CrewAI

Work closely with data scientists & business teams to understand requirements

Containerize and deploy applications using Docker & Kubernetes

Ensure data quality, observability, and security compliance

Maintain end-to-end documentation for pipelines & processes

Identify performance bottlenecks and troubleshoot data issues

Additional Technical Expertise

Generative AI fundamentals :

LLM fine-tuning, prompt engineering, RAG

ML basics :

feature engineering, model training

Cloud platforms : Azure (primary), AWS / GCP (added advantage)

Big data tools : Spark, Hadoop, Kafka

ML frameworks : TensorFlow, PyTorch

Preferred Qualifications

Azure certifications

Experience with big data systems

Knowledge of ML / Data Science concepts