Data Engineering Manager - Python & AI (7 to 12 yrs)

AIMLEAPPrayagraj(Allahabad), IN

16 hours ago

Job description

Data Engineering Manager – Python & AI

Experience : 7 to 12 Years

Location : Remote (Work from Home) / Bangalore / India

Mode of Engagement : Full-time

No of Positions : 2

Educational Qualification : MBA / B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / E-commerce / FinTech / Healthcare

Notice Period : Immediate

What We Are Looking For :

7–12 years of experience in managing end-to-end data engineering and delivery projects , including Python-based data scraping, ETL, and dashboarding .
Proven experience in leading teams , setting up complex data engineering projects , and establishing data pipelines integrating scraping, processing, and analytics.
Hands-on proficiency in Python, SQL, ETL frameworks , and web scraping , with working knowledge of AI tools and automation frameworks like LangChain, LlamaIndex, or AutoGen .
Experience with AWS, GitHub, CI / CD, Jira, ClickUp , and DevOps tools for delivery tracking, workflow automation, and performance optimization.

Responsibilities :

Lead and manage multiple data engineering and AI-enabled delivery projects , ensuring scalability, performance, and high-quality outcomes.

Architect and implement data pipelines and scraping systems using Python, Pandas, BeautifulSoup, or Scrapy, integrating AI-based automation where applicable.

Collaborate with cross-functional teams — Data Engineers, Python Developers, and Analysts — to design, build, and optimize large-scale data systems and dashboards.

Drive automation and AI adoption across projects to improve efficiency in scraping, transformation, and reporting workflows .

Work closely with clients across IT, FinTech, E-commerce, and Healthcare domains to understand technical needs, plan delivery schedules, and ensure data integrity.

Establish and monitor data quality, governance, and compliance standards throughout project execution.

Mentor and guide team members on Python best practices, AI frameworks, and data engineering design patterns .

Manage project timelines, status reporting, and delivery metrics using Jira, ClickUp, and CI / CD pipelines .

Qualifications :

Bachelor's or master's degree in engineering, Computer Science, or related field.

Strong hands-on expertise in Python, SQL, ETL, Advanced Excel, Power BI, and web scraping frameworks .

Exposure to AI and automation frameworks (LangChain, LlamaIndex, AutoGen) preferred.

Working knowledge of AWS , GitHub , DevOps (Docker, Kubernetes) , and workflow automation tools .

Proven experience managing cross-functional data delivery teams and handling international client communication .

Excellent analytical, leadership, and problem-solving skills.

Project Management certifications ( PMP, Agile, or Scrum Master ) are an added advantage.

Create a job alert for this search

Data Engineering Manager • Prayagraj(Allahabad), IN

Related jobs

Senior Analytics Insights Enginee...

Konnexus Consulting GroupAU

Promoted

Data Engineering Manager – AI & Automation (7 to 12 Years)

AIMLEAPPrayagraj(Allahabad), IN

Data Engineering Manager – AI & Automation.Remote (Work from Home) / Bangalore / India .Tech / MCA / Computer Science / IT . IT / Data / AI / E-commerce / FinTech / Healthcare .Python-based data scr...Show moreLast updated: 1 day ago

Promoted

Senior AWS Data Engineer

CYAN360Prayagraj(Allahabad), IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Manager – AI & Automation Delivery Lead

AccentureAU

We work with one shared purpose : to deliver on the promise of technology and human ingenuity.Every day, more than 791,000 of us help our stakeholders continuously reinvent.Together, we drive positi...Show moreLast updated: 30+ days ago

Promoted

Engineering Manager - Data Platform

CoinbasePrayagraj(Allahabad), IN

Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 2 days ago

Promoted

Engineering Manager

TamaraPrayagraj(Allahabad), IN

Tamara is the leading fintech platform in Saudi Arabia and the wider GCC region with a mission to help people make their dreams come true by building the most customer-centric financial super-app o...Show moreLast updated: 19 days ago

Promoted
New!

AI / ML & Data Engineer

Mindfire SolutionsPrayagraj(Allahabad), IN

We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 16 hours ago

AI Engineering Associate Director / Principal Engineer

AccentureAU

We work with one shared purpose : to deliver on the promise of technology and human ingenuity.Every day, more than 775,000 of us help our stakeholders continuously reinvent.Together, we drive positi...Show moreLast updated: 30+ days ago

Promoted

Agentic AI Tech lead || Dallas, TX

Select Minds LLCPrayagraj(Allahabad), IN

Build and orchestrate agent workflows using LangChain, OpenAgents, or CrewAI.Implement tool wrappers, memory mechanisms, and API integrations for agent action execution. Lead POCs, code reviews, des...Show moreLast updated: 9 days ago

Promoted

Senior Data Integration Engineer

IndsafriPrayagraj(Allahabad), IN

Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 8 days ago

Databricks Data Engineer Manager

AccentureAU

Join our dynamic Data & AI practice as a.Databricks Data Engineering Manager.You will guide high-performing teams to design and implement scalable data solutions leveraging Databricks and cloud...Show moreLast updated: 30+ days ago

Senior Engineering Manager - Cloud Platform

Octopus DeployAU

Octopus Deploy sets the standard for Continuous Delivery, empowering software teams to deliver value in an agile way.Over 4,000 organizations globally – including Ubisoft, Xero, Stack Overflow, NAS...Show moreLast updated: 30+ days ago

Associate Manager – AI & Full Stack Developer

AccentureAU

Promoted

Data Engineering Role

100x.incPrayagraj(Allahabad), IN

At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 19 days ago

Promoted

Gen Ai - Engineer

Diligente TechnologiesPrayagraj(Allahabad), IN

Hands-on experience with Generative AI (GenAI) and agent-based AI frameworks.Proficiency in backend programming languages such as Node. Strong knowledge of both SQL and NoSQL databases.Experience wi...Show moreLast updated: 6 days ago

Promoted

Associate Solutions Manager

ElucidataPrayagraj(Allahabad), IN

Delhi / Bangalore (3 days in office).Elucidata is a TechBio Company headquartered in San Francisco.Our mission is to unleash personalized medicine using AI and multi-omics, multimodal data.Elucidata’...Show moreLast updated: 9 days ago

Promoted

Manager, Boomi AI Solutions

RSM US LLPPrayagraj(Allahabad), IN

Job Description : Manager – Boomi AI Solutions.We are seeking a Manager – Boomi AI Solutions to help drive the development of AI-powered business solutions using the Boomi platform.This is a technic...Show moreLast updated: 9 days ago

Promoted

Data Engineering Azure databricks

EXLPrayagraj(Allahabad), IN

Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Work with stakeholders to unders...Show moreLast updated: 24 days ago