Data Engineering Manager - Python & AI (7 to 12 yrs)

AIMLEAPKolkata, IN

1 day ago

Job description

Data Engineering Manager – Python & AI

Experience : 7 to 12 Years

Location : Remote (Work from Home) / Bangalore / India

Mode of Engagement : Full-time

No of Positions : 2

Educational Qualification : MBA / B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / E-commerce / FinTech / Healthcare

Notice Period : Immediate

What We Are Looking For :

7–12 years of experience in managing end-to-end data engineering and delivery projects , including Python-based data scraping, ETL, and dashboarding .
Proven experience in leading teams , setting up complex data engineering projects , and establishing data pipelines integrating scraping, processing, and analytics.
Hands-on proficiency in Python, SQL, ETL frameworks , and web scraping , with working knowledge of AI tools and automation frameworks like LangChain, LlamaIndex, or AutoGen .
Experience with AWS, GitHub, CI / CD, Jira, ClickUp , and DevOps tools for delivery tracking, workflow automation, and performance optimization.

Responsibilities :

Lead and manage multiple data engineering and AI-enabled delivery projects , ensuring scalability, performance, and high-quality outcomes.

Architect and implement data pipelines and scraping systems using Python, Pandas, BeautifulSoup, or Scrapy, integrating AI-based automation where applicable.

Collaborate with cross-functional teams — Data Engineers, Python Developers, and Analysts — to design, build, and optimize large-scale data systems and dashboards.

Drive automation and AI adoption across projects to improve efficiency in scraping, transformation, and reporting workflows .

Work closely with clients across IT, FinTech, E-commerce, and Healthcare domains to understand technical needs, plan delivery schedules, and ensure data integrity.

Establish and monitor data quality, governance, and compliance standards throughout project execution.

Mentor and guide team members on Python best practices, AI frameworks, and data engineering design patterns .

Manage project timelines, status reporting, and delivery metrics using Jira, ClickUp, and CI / CD pipelines .

Qualifications :

Bachelor's or master's degree in engineering, Computer Science, or related field.

Strong hands-on expertise in Python, SQL, ETL, Advanced Excel, Power BI, and web scraping frameworks .

Exposure to AI and automation frameworks (LangChain, LlamaIndex, AutoGen) preferred.

Working knowledge of AWS , GitHub , DevOps (Docker, Kubernetes) , and workflow automation tools .

Proven experience managing cross-functional data delivery teams and handling international client communication .

Excellent analytical, leadership, and problem-solving skills.

Project Management certifications ( PMP, Agile, or Scrum Master ) are an added advantage.

Create a job alert for this search

Data Engineering Manager • Kolkata, IN

Related jobs

Promoted

Engineering Manager - Data Platform

CoinbaseKolkata, IN

Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 2 days ago

Promoted

Data Engineering Azure databricks

EXLKolkata, IN

Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Work with stakeholders to unders...Show moreLast updated: 24 days ago

Promoted
New!

Senior AI-ML Engineer

Myridius x Aethereuskolkata, west bengal, in

Aethereus is now part of Myridius, formerly known as RCG Global Services.This strategic integration combines Aethereus’ expertise in cutting-edge solutions with Myridius’ legacy of delivering trans...Show moreLast updated: 20 hours ago

Promoted

Engineering Manager AI & Automation [T500-20547]

ANSRkolkata, west bengal, in

Headquartered in Berlin, Germany, 4flow provides consulting, software and services for logistics and supply chain management. More than 1300 team members leverage their supply chain expertise and IT...Show moreLast updated: 29 days ago

Promoted

Lead Data Engineer

ITQube LTDkolkata, west bengal, in

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 20 days ago

Promoted

Data Manager

trg.recruitmentkolkata, west bengal, in

Pune or Remote (India) | Contract.Are you an experienced Data Manager who enjoys leading high-performing data teams and delivering high-quality data products that make a difference?.In this role, y...Show moreLast updated: 8 days ago

Promoted

Data Science Manager

ConfidentialKolkata

Lead and mentor a team of data scientists to deliver actionable insights and solutions.Oversee the design and implementation of machine learning models and data workflows.Collaborate with cross-fun...Show moreLast updated: 30+ days ago

Promoted

Senior AWS Data Engineer

CYAN360kolkata, India

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 2 days ago

Promoted

Data Engineering Role

100x.incKolkata, IN

At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 19 days ago

Promoted

Senior - AI Engineer

Magnus India Consulting Serviceskolkata, west bengal, in

Excellent Job Opportunity for a Leading conglomerate.Years experience in Design, develop, and maintain backend services and APIs to support AI / ML applications at scale. Build scalable microservices ...Show moreLast updated: 9 days ago

Promoted

Senior AI Engineer

Kanerika Inckolkata, west bengal, in

We are seeking an experienced Senior AI Engineer with 3+years of experience to join our dynamic team, driving innovation in AI-driven solutions with a global impact. This role is specifically tailor...Show moreLast updated: 30+ days ago

Promoted

Data Engineering Manager – AI & Automation (7 to 12 Years)

AIMLEAPKolkata, IN

Data Engineering Manager – AI & Automation.Remote (Work from Home) / Bangalore / India .Tech / MCA / Computer Science / IT . IT / Data / AI / E-commerce / FinTech / Healthcare .Python-based data scr...Show moreLast updated: 1 day ago

Promoted

Senior AI Developer

Movado Group, Inckolkata, India

The Senior AI Developer will play a critical role in designing and developing intelligent automation solutions that integrate SAP and non-SAP data sources to address complex business challenges.The...Show moreLast updated: 2 days ago

Promoted

Engineering Manager

ConfidentialKolkata

Lead and mentor a high-performing data engineering and AI / ML team.Drive scalable data pipeline and automation solution development. Execute data intelligence strategies aligned with business goals.L...Show moreLast updated: 30+ days ago

Promoted

Manager / Senior Manager - Databricks

Tiger Analyticskolkata, India

Manager / Senior Manager - Databricks.Tiger Analytics is a global leader in data and analytics services, helping organizations solve. We are looking for a Manager / Senior Manager - Databricks with a st...Show moreLast updated: 2 days ago

Promoted

Webskitters - AI / ML Engineer - PyTorch / Tensorflow

Webskitters Technology Solutions Pvt LtdKolkata

Description : Key Responsibilities : - Develop, test, and deploy machine...Show moreLast updated: 15 days ago

Promoted

Manager, Boomi AI Solutions

RSM US LLPKolkata, IN

Job Description : Manager – Boomi AI Solutions.We are seeking a Manager – Boomi AI Solutions to help drive the development of AI-powered business solutions using the Boomi platform.This is a technic...Show moreLast updated: 9 days ago

Promoted

AI Delivery Manager / Project Manager

Innodata Inc.Kolkata, IN

We’re hiring a project manager to drive execution of custom-built AI solutions—including copilots, RAG systems, and agentic workflows. You’ll work closely with engineers, solution architects, and cl...Show moreLast updated: 7 days ago