Data Engineering Manager - Python & AI (7 to 12 yrs)

AIMLEAPBharatpur, IN

5 days ago

Job description

Data Engineering Manager – Python & AI

Experience : 7 to 12 Years

Location : Remote (Work from Home) / Bangalore / India

Mode of Engagement : Full-time

No of Positions : 2

Educational Qualification : MBA / B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / E-commerce / FinTech / Healthcare

Notice Period : Immediate

What We Are Looking For :

7–12 years of experience in managing end-to-end data engineering and delivery projects , including Python-based data scraping, ETL, and dashboarding .
Proven experience in leading teams , setting up complex data engineering projects , and establishing data pipelines integrating scraping, processing, and analytics.
Hands-on proficiency in Python, SQL, ETL frameworks , and web scraping , with working knowledge of AI tools and automation frameworks like LangChain, LlamaIndex, or AutoGen .
Experience with AWS, GitHub, CI / CD, Jira, ClickUp , and DevOps tools for delivery tracking, workflow automation, and performance optimization.

Responsibilities :

Lead and manage multiple data engineering and AI-enabled delivery projects , ensuring scalability, performance, and high-quality outcomes.

Architect and implement data pipelines and scraping systems using Python, Pandas, BeautifulSoup, or Scrapy, integrating AI-based automation where applicable.

Collaborate with cross-functional teams — Data Engineers, Python Developers, and Analysts — to design, build, and optimize large-scale data systems and dashboards.

Drive automation and AI adoption across projects to improve efficiency in scraping, transformation, and reporting workflows .

Work closely with clients across IT, FinTech, E-commerce, and Healthcare domains to understand technical needs, plan delivery schedules, and ensure data integrity.

Establish and monitor data quality, governance, and compliance standards throughout project execution.

Mentor and guide team members on Python best practices, AI frameworks, and data engineering design patterns .

Manage project timelines, status reporting, and delivery metrics using Jira, ClickUp, and CI / CD pipelines .

Qualifications :

Bachelor's or master's degree in engineering, Computer Science, or related field.

Strong hands-on expertise in Python, SQL, ETL, Advanced Excel, Power BI, and web scraping frameworks .

Exposure to AI and automation frameworks (LangChain, LlamaIndex, AutoGen) preferred.

Working knowledge of AWS , GitHub , DevOps (Docker, Kubernetes) , and workflow automation tools .

Proven experience managing cross-functional data delivery teams and handling international client communication .

Excellent analytical, leadership, and problem-solving skills.

Project Management certifications ( PMP, Agile, or Scrum Master ) are an added advantage.

Create a job alert for this search

Data Engineering Manager • Bharatpur, IN

Related jobs

Promoted

Senior - AI Engineer

Magnus India Consulting Servicesbharatpur, India

Excellent Job Opportunity for a Leading conglomerate.Years experience in Design, develop, and maintain backend services and APIs to support AI / ML applications at scale. Build scalable microservices ...Show moreLast updated: 7 days ago

Promoted

Analytics Manager [T500-21056]

Talent500Bharatpur, IN

Talent500 is hiring for one of its clients.Careem is the internet platform for the greater Middle East region.A pioneer of the region's ride-hailing economy, Careem is expanding services across its...Show moreLast updated: 3 days ago

Promoted

Senior AI Developer

Movado Group, Incbharatpur, India

The Senior AI Developer will play a critical role in designing and developing intelligent automation solutions that integrate SAP and non-SAP data sources to address complex business challenges.The...Show moreLast updated: 7 days ago

Promoted

Senior AI Engineer

Kanerika Incbharatpur, India

We are seeking an experienced Senior AI Engineer with 3+years of experience to join our dynamic team, driving innovation in AI-driven solutions with a global impact. This role is specifically tailor...Show moreLast updated: 7 days ago

Promoted

Python Data Engineer

iVoyantbharatpur, India

One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 3 days ago

Promoted

Data Engineering Role

100x.incBharatpur, IN

At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 24 days ago

Promoted

Manager, Boomi AI Solutions

RSM US LLPBharatpur, IN

Job Description : Manager – Boomi AI Solutions.We are seeking a Manager – Boomi AI Solutions to help drive the development of AI-powered business solutions using the Boomi platform.This is a technic...Show moreLast updated: 13 days ago

Promoted

Senior AWS Data Engineer

CYAN360bharatpur, India

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 7 days ago

Promoted

Engineering Manager

Curately AI, IncBharatpur, IN

The ideal candidate will be responsible for managing and inspiring his or her team to achieve their performance metrics.Your role will involve strategizing, project management, part staff managemen...Show moreLast updated: 2 days ago

Promoted

Senior Data Integration Engineer

IndsafriBharatpur, IN

Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 13 days ago

Promoted

AI / ML & Data Engineer

Mindfire SolutionsBharatpur, IN

We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 5 days ago

Promoted

Senior AI-ML Engineer

Myridius x Aethereusbharatpur, India

Aethereus is now part of Myridius, formerly known as RCG Global Services.This strategic integration combines Aethereus’ expertise in cutting-edge solutions with Myridius’ legacy of delivering trans...Show moreLast updated: 4 days ago

Promoted

Associate Solutions Manager

ElucidataBharatpur, IN

Delhi / Bangalore (3 days in office).Elucidata is a TechBio Company headquartered in San Francisco.Our mission is to unleash personalized medicine using AI and multi-omics, multimodal data.Elucidata’...Show moreLast updated: 13 days ago

Promoted

Gen Ai - Engineer

Diligente TechnologiesBharatpur, IN

Hands-on experience with Generative AI (GenAI) and agent-based AI frameworks.Proficiency in backend programming languages such as Node. Strong knowledge of both SQL and NoSQL databases.Experience wi...Show moreLast updated: 11 days ago

Promoted

Engineering Manager AI & Automation [T500-20547]

ANSRbharatpur, India

Headquartered in Berlin, Germany, 4flow provides consulting, software and services for logistics and supply chain management. More than 1300 team members leverage their supply chain expertise and IT...Show moreLast updated: 7 days ago

Promoted

Lead Data Engineer

ITQube LTDbharatpur, India

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 7 days ago

Promoted

Senior AI / ML Engineer

Prophecy Technologiesbharatpur, India

We are seeking a highly skilled Senior AI / ML Engineer with deep expertise in Python programming, LLMs, and Generative AI ecosystems. The ideal candidate will have strong fundamentals in machine lear...Show moreLast updated: 2 days ago

Promoted

AWS Data Engineer

TerraGiGBharatpur, IN

Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 3 days ago