Data Engineering Manager - Python & AI (7 to 12 yrs)

AIMLEAPCoimbatore, IN

6 days ago

Job description

Data Engineering Manager – Python & AI

Experience : 7 to 12 Years

Location : Remote (Work from Home) / Bangalore / India

Mode of Engagement : Full-time

No of Positions : 2

Educational Qualification : MBA / B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / E-commerce / FinTech / Healthcare

Notice Period : Immediate

What We Are Looking For :

7–12 years of experience in managing end-to-end data engineering and delivery projects , including Python-based data scraping, ETL, and dashboarding .
Proven experience in leading teams , setting up complex data engineering projects , and establishing data pipelines integrating scraping, processing, and analytics.
Hands-on proficiency in Python, SQL, ETL frameworks , and web scraping , with working knowledge of AI tools and automation frameworks like LangChain, LlamaIndex, or AutoGen .
Experience with AWS, GitHub, CI / CD, Jira, ClickUp , and DevOps tools for delivery tracking, workflow automation, and performance optimization.

Responsibilities :

Lead and manage multiple data engineering and AI-enabled delivery projects , ensuring scalability, performance, and high-quality outcomes.

Architect and implement data pipelines and scraping systems using Python, Pandas, BeautifulSoup, or Scrapy, integrating AI-based automation where applicable.

Collaborate with cross-functional teams — Data Engineers, Python Developers, and Analysts — to design, build, and optimize large-scale data systems and dashboards.

Drive automation and AI adoption across projects to improve efficiency in scraping, transformation, and reporting workflows .

Work closely with clients across IT, FinTech, E-commerce, and Healthcare domains to understand technical needs, plan delivery schedules, and ensure data integrity.

Establish and monitor data quality, governance, and compliance standards throughout project execution.

Mentor and guide team members on Python best practices, AI frameworks, and data engineering design patterns .

Manage project timelines, status reporting, and delivery metrics using Jira, ClickUp, and CI / CD pipelines .

Qualifications :

Bachelor's or master's degree in engineering, Computer Science, or related field.

Strong hands-on expertise in Python, SQL, ETL, Advanced Excel, Power BI, and web scraping frameworks .

Exposure to AI and automation frameworks (LangChain, LlamaIndex, AutoGen) preferred.

Working knowledge of AWS , GitHub , DevOps (Docker, Kubernetes) , and workflow automation tools .

Proven experience managing cross-functional data delivery teams and handling international client communication .

Excellent analytical, leadership, and problem-solving skills.

Project Management certifications ( PMP, Agile, or Scrum Master ) are an added advantage.

Create a job alert for this search

Data Engineering Manager • Coimbatore, IN

Related jobs

Promoted

Engineering Manager

TamaraTiruppur, IN

Tamara is the leading fintech platform in Saudi Arabia and the wider GCC region with a mission to help people make their dreams come true by building the most customer-centric financial super-app o...Show moreLast updated: 25 days ago

AWS Data Engineer - Manager

Talent WorxCoimbatore, TN, IN

Quick Apply

We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background i...Show moreLast updated: 29 days ago

Promoted

Analytics Manager [T500-21056]

Talent500Coimbatore, IN

Talent500 is hiring for one of its clients.Careem is the internet platform for the greater Middle East region.A pioneer of the region's ride-hailing economy, Careem is expanding services across its...Show moreLast updated: 4 days ago

Promoted

Senior AI Developer

Movado Group, Incpalakkad, India

The Senior AI Developer will play a critical role in designing and developing intelligent automation solutions that integrate SAP and non-SAP data sources to address complex business challenges.The...Show moreLast updated: 8 days ago

Promoted

Senior AWS Data Engineer

CYAN360coimbatore, India

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 8 days ago

Promoted

Senior AI-ML Engineer

Myridius x Aethereuscoimbatore, India

Aethereus is now part of Myridius, formerly known as RCG Global Services.This strategic integration combines Aethereus’ expertise in cutting-edge solutions with Myridius’ legacy of delivering trans...Show moreLast updated: 6 days ago

Promoted

Technical Project Manager-Data Engineering

Reflections Info SystemsPalakkad, IN

We are looking for 13+years experienced candidates for this role.Preferred Location : Cochin / Trivandrum / Chennai.Overall 13+ Years of Experience in IT with 6+ years of experience as a Technical Produ...Show moreLast updated: 30+ days ago

Promoted

Manager, Boomi AI Solutions

RSM US LLPCoimbatore, IN

Job Description : Manager – Boomi AI Solutions.We are seeking a Manager – Boomi AI Solutions to help drive the development of AI-powered business solutions using the Boomi platform.This is a technic...Show moreLast updated: 15 days ago

Promoted

Azure Data Engineering

LTIMindtreeCoimbatore, Tamil Nadu, India

We are hiring for ADB +ADF +Py spark +SQL +Synapse.Specialist - Data Engineering 5 to 8 Yrs.Senior Specialist - Data Engineering 8 to 12 yrs.Show moreLast updated: 30+ days ago

Promoted

Senior AI Engineer

Kanerika Inccoimbatore, India

We are seeking an experienced Senior AI Engineer with 3+years of experience to join our dynamic team, driving innovation in AI-driven solutions with a global impact. This role is specifically tailor...Show moreLast updated: 8 days ago

Promoted

Data Engineering Role

100x.incPalakkad, IN

At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 25 days ago

Promoted

AI / ML & Data Engineer

Mindfire SolutionsCoimbatore, IN

We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 6 days ago

Promoted

Gen Ai - Engineer

Diligente TechnologiesPalakkad, IN

Hands-on experience with Generative AI (GenAI) and agent-based AI frameworks.Proficiency in backend programming languages such as Node. Strong knowledge of both SQL and NoSQL databases.Experience wi...Show moreLast updated: 12 days ago

Promoted

AWS Data Engineer

TerraGiGPalakkad, IN

Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 4 days ago

Promoted

AWS Data Engineer

Tata Consultancy Servicescoimbatore, tamil nadu, in

Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 2 days ago

Promoted

Data Engineering Manager - ETL Tools

Cloud DestinationsCoimbatore

Description : Company Overview : Cloud Destinations is a Silicon Valley-headquartered, well-established techno...Show moreLast updated: 13 days ago

Promoted

Engineering Manager AI & Automation [T500-20547]

ANSRpalakkad, India

Headquartered in Berlin, Germany, 4flow provides consulting, software and services for logistics and supply chain management. More than 1300 team members leverage their supply chain expertise and IT...Show moreLast updated: 8 days ago

Promoted

(Urgent) Technical Project Manager-Data Engineering

Reflections Info SystemsPalakkad, Kerala, India

We are looking for 13+years experienced candidates for this role.Mode : Hybrid Preferred Location : Cochin / Trivandrum / Chennai Primary Skills : - Overall 13+ Years of Experience in IT with 6+ years...Show moreLast updated: 15 days ago