Data Engineering Manager - Python & AI (7 to 12 yrs)

AIMLEAPPune, IN

16 hours ago

Job description

Data Engineering Manager – Python & AI

Experience : 7 to 12 Years

Location : Remote (Work from Home) / Bangalore / India

Mode of Engagement : Full-time

No of Positions : 2

Educational Qualification : MBA / B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / E-commerce / FinTech / Healthcare

Notice Period : Immediate

What We Are Looking For :

7–12 years of experience in managing end-to-end data engineering and delivery projects , including Python-based data scraping, ETL, and dashboarding .
Proven experience in leading teams , setting up complex data engineering projects , and establishing data pipelines integrating scraping, processing, and analytics.
Hands-on proficiency in Python, SQL, ETL frameworks , and web scraping , with working knowledge of AI tools and automation frameworks like LangChain, LlamaIndex, or AutoGen .
Experience with AWS, GitHub, CI / CD, Jira, ClickUp , and DevOps tools for delivery tracking, workflow automation, and performance optimization.

Responsibilities :

Lead and manage multiple data engineering and AI-enabled delivery projects , ensuring scalability, performance, and high-quality outcomes.

Architect and implement data pipelines and scraping systems using Python, Pandas, BeautifulSoup, or Scrapy, integrating AI-based automation where applicable.

Collaborate with cross-functional teams — Data Engineers, Python Developers, and Analysts — to design, build, and optimize large-scale data systems and dashboards.

Drive automation and AI adoption across projects to improve efficiency in scraping, transformation, and reporting workflows .

Work closely with clients across IT, FinTech, E-commerce, and Healthcare domains to understand technical needs, plan delivery schedules, and ensure data integrity.

Establish and monitor data quality, governance, and compliance standards throughout project execution.

Mentor and guide team members on Python best practices, AI frameworks, and data engineering design patterns .

Manage project timelines, status reporting, and delivery metrics using Jira, ClickUp, and CI / CD pipelines .

Qualifications :

Bachelor's or master's degree in engineering, Computer Science, or related field.

Strong hands-on expertise in Python, SQL, ETL, Advanced Excel, Power BI, and web scraping frameworks .

Exposure to AI and automation frameworks (LangChain, LlamaIndex, AutoGen) preferred.

Working knowledge of AWS , GitHub , DevOps (Docker, Kubernetes) , and workflow automation tools .

Proven experience managing cross-functional data delivery teams and handling international client communication .

Excellent analytical, leadership, and problem-solving skills.

Project Management certifications ( PMP, Agile, or Scrum Master ) are an added advantage.

Create a job alert for this search

Data Engineering Manager • Pune, IN

Related jobs

Promoted

Data Engineering Azure databricks

EXLPune, IN

Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Work with stakeholders to unders...Show moreLast updated: 24 days ago

Promoted

Manager, Data Engineer

MastercardPune, Maharashtra, India

Manager, Data Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow.Mastercard is a global technology company in the payments industry. Our mission is to connect and power...Show moreLast updated: 8 days ago

Promoted

Senior Manager - Data Science & Analytics

Right Move Staffing Solutions Private LimitedPune

Key Responsibilities : - Lead and manage a team of data scientists and analysts, providing guidance on analytics, modeling, and best practices.Design, develop...Show moreLast updated: 18 days ago

Promoted

Manager, Boomi AI Solutions

RSM US LLPPune, IN

Job Description : Manager – Boomi AI Solutions.We are seeking a Manager – Boomi AI Solutions to help drive the development of AI-powered business solutions using the Boomi platform.This is a technic...Show moreLast updated: 9 days ago

Promoted

BI Engineering Lead

Persistent SystemsPune, Maharashtra, India

About Position : The BI Lead will be responsible for designing advanced Power BI dashboards, integrating data from Snowflake and SQL Server, and delivering insights through effective data visualiza...Show moreLast updated: 5 days ago

Promoted

Engineering Manager - Data Platform

CoinbasePune, IN

Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 2 days ago

Promoted

Data Manager

trg.recruitmentPune, Maharashtra, India

Pune or Remote (India) | Contract.Are you an experienced Data Manager who enjoys leading high-performing data teams and delivering high-quality data products that make a difference?.In this role, y...Show moreLast updated: 8 days ago

Promoted

Lead Data Engineer

ITQube LTDPune, Maharashtra, India

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 19 days ago

Promoted

Manager - Generative AI

Novotree Minds Consulting Pvt LimitedPune

Key Responsibilities : - Lead and deliver Generative AI projects from requirements gathering to deployment.Work hands-on with LLMs, RAG models, Lang...Show moreLast updated: 30+ days ago

Promoted

Senior Engineering Manager - Python / Java

Recruitment Hub 365Pune

Open Position : Senior Engineering Manager Location : Pune (Hybrid) Experience : 10 to 15 Years &...Show moreLast updated: 30+ days ago

Promoted

Data Engineering Manager – AI & Automation (7 to 12 Years)

AIMLEAPPune, IN

Data Engineering Manager – AI & Automation.Remote (Work from Home) / Bangalore / India .Tech / MCA / Computer Science / IT . IT / Data / AI / E-commerce / FinTech / Healthcare .Python-based data scr...Show moreLast updated: 1 day ago

Promoted

Software Engineering Manager

Sav.comPune, Maharashtra, India

Title : Engineering Manager / Software Architect About Us : We are a fast-growing AI domain registrar and website builder focused on automation, scalability, and user experience.Our development team i...Show moreLast updated: 1 day ago

Promoted

Technical Manager

PeoplefyPune, Maharashtra, India

Job Title : Technical Manager – Data Engineering Location : Pune, India Experience : 12–15 years (including 2–3 years in a managerial role) Role Summary : Lead a team of data engineers and architec...Show moreLast updated: 9 days ago

Promoted

Publicis Sapient - Data Engineering Manager / Architect

Publicis SapientPune

Manager Data Engineer As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing GCP / Azure ...Show moreLast updated: 30+ days ago

Promoted

Data Engineering Role

100x.incPune, IN

At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 19 days ago

Promoted

Engineering Manager

Persistent SystemsPune, Maharashtra, India

About Position : We are focusing on Data Lake Integration, Security Logging & Threat Monitoring, Application On-boarding We are seeking a highly skilled and experienced Security Data Engineer with ...Show moreLast updated: 9 days ago

Promoted

Engineering Manager AI & Automation [T500-20547]

ANSRpune, maharashtra, in

Headquartered in Berlin, Germany, 4flow provides consulting, software and services for logistics and supply chain management. More than 1300 team members leverage their supply chain expertise and IT...Show moreLast updated: 29 days ago

Promoted

Technical Manager - Data Engineering

PeoplefyPune

Description : Job Title : Technical Manager Data Engineering Location : Pune, India Show moreLast updated: 8 days ago