Data Engineering Manager - Python & AI (7 to 12 yrs)

AIMLEAPJunagadh, IN

2 days ago

Job description

Data Engineering Manager – Python & AI

Experience : 7 to 12 Years

Location : Remote (Work from Home) / Bangalore / India

Mode of Engagement : Full-time

No of Positions : 2

Educational Qualification : MBA / B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / E-commerce / FinTech / Healthcare

Notice Period : Immediate

What We Are Looking For :

7–12 years of experience in managing end-to-end data engineering and delivery projects , including Python-based data scraping, ETL, and dashboarding .
Proven experience in leading teams , setting up complex data engineering projects , and establishing data pipelines integrating scraping, processing, and analytics.
Hands-on proficiency in Python, SQL, ETL frameworks , and web scraping , with working knowledge of AI tools and automation frameworks like LangChain, LlamaIndex, or AutoGen .
Experience with AWS, GitHub, CI / CD, Jira, ClickUp , and DevOps tools for delivery tracking, workflow automation, and performance optimization.

Responsibilities :

Lead and manage multiple data engineering and AI-enabled delivery projects , ensuring scalability, performance, and high-quality outcomes.

Architect and implement data pipelines and scraping systems using Python, Pandas, BeautifulSoup, or Scrapy, integrating AI-based automation where applicable.

Collaborate with cross-functional teams — Data Engineers, Python Developers, and Analysts — to design, build, and optimize large-scale data systems and dashboards.

Drive automation and AI adoption across projects to improve efficiency in scraping, transformation, and reporting workflows .

Work closely with clients across IT, FinTech, E-commerce, and Healthcare domains to understand technical needs, plan delivery schedules, and ensure data integrity.

Establish and monitor data quality, governance, and compliance standards throughout project execution.

Mentor and guide team members on Python best practices, AI frameworks, and data engineering design patterns .

Manage project timelines, status reporting, and delivery metrics using Jira, ClickUp, and CI / CD pipelines .

Qualifications :

Bachelor's or master's degree in engineering, Computer Science, or related field.

Strong hands-on expertise in Python, SQL, ETL, Advanced Excel, Power BI, and web scraping frameworks .

Exposure to AI and automation frameworks (LangChain, LlamaIndex, AutoGen) preferred.

Working knowledge of AWS , GitHub , DevOps (Docker, Kubernetes) , and workflow automation tools .

Proven experience managing cross-functional data delivery teams and handling international client communication .

Excellent analytical, leadership, and problem-solving skills.

Project Management certifications ( PMP, Agile, or Scrum Master ) are an added advantage.

Create a job alert for this search

Data Engineering Manager • Junagadh, IN

Related jobs

Promoted

Data Engineering Role

100x.incJunagadh, IN

At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 21 days ago

Promoted

Analytics Manager [T500-21056]

Talent500Junagadh, IN

Talent500 is hiring for one of its clients.Careem is the internet platform for the greater Middle East region.A pioneer of the region's ride-hailing economy, Careem is expanding services across its...Show moreLast updated: 1 day ago

Promoted

AI Delivery Manager / Project Manager

Innodata Inc.Junagadh, IN

We’re hiring a project manager to drive execution of custom-built AI solutions—including copilots, RAG systems, and agentic workflows. You’ll work closely with engineers, solution architects, and cl...Show moreLast updated: 9 days ago

Promoted
New!

Engineering Manager

JA Solutions India Private Limitedjunagadh, gujarat, in

Hiring : Engineering Manager – Ecommerce Product Company (Pune-based Client).Are you passionate about building scalable software, leading high-performing teams, and driving innovation with cutting-e...Show moreLast updated: 19 hours ago

Promoted

Senior - AI Engineer

Magnus India Consulting Servicesjunagadh, gujarat, in

Excellent Job Opportunity for a Leading conglomerate.Years experience in Design, develop, and maintain backend services and APIs to support AI / ML applications at scale. Build scalable microservices ...Show moreLast updated: 11 days ago

Promoted

Engineering Manager - Data Platform

CoinbaseJunagadh, IN

Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 4 days ago

Promoted

lead Data Engineer

CozzeraJunagadh, IN

Location : Remote ( 1 week from noida office then remote).We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in. Delta Lake, Spark, MLflow), and modern orchestration ...Show moreLast updated: 1 day ago

Promoted

Engineering Manager AI & Automation [T500-20547]

ANSRjunagadh, gujarat, in

Headquartered in Berlin, Germany, 4flow provides consulting, software and services for logistics and supply chain management. More than 1300 team members leverage their supply chain expertise and IT...Show moreLast updated: 30+ days ago

Promoted

AI / ML & Data Engineer

Mindfire SolutionsJunagadh, IN

We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 2 days ago

Promoted

Gen Ai - Engineer

Diligente TechnologiesJunagadh, IN

Hands-on experience with Generative AI (GenAI) and agent-based AI frameworks.Proficiency in backend programming languages such as Node. Strong knowledge of both SQL and NoSQL databases.Experience wi...Show moreLast updated: 9 days ago

Promoted

Agentic AI Tech lead || Dallas, TX

Select Minds LLCJunagadh, IN

Build and orchestrate agent workflows using LangChain, OpenAgents, or CrewAI.Implement tool wrappers, memory mechanisms, and API integrations for agent action execution. Lead POCs, code reviews, des...Show moreLast updated: 11 days ago

Promoted

Lead Data Engineer

ITQube LTDjunagadh, gujarat, in

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 21 days ago

Promoted

Senior Data Integration Engineer

IndsafriJunagadh, IN

Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 11 days ago

Promoted
New!

Senior AI / ML Engineer

Prophecy Technologiesjunagadh, gujarat, in

We are seeking a highly skilled Senior AI / ML Engineer with deep expertise in Python programming, LLMs, and Generative AI ecosystems. The ideal candidate will have strong fundamentals in machine lear...Show moreLast updated: 19 hours ago

Promoted

Manager, Boomi AI Solutions

RSM US LLPJunagadh, IN

Job Description : Manager – Boomi AI Solutions.We are seeking a Manager – Boomi AI Solutions to help drive the development of AI-powered business solutions using the Boomi platform.This is a technic...Show moreLast updated: 11 days ago

Promoted

Engineering Manager

TamaraJunagadh, IN

Tamara is the leading fintech platform in Saudi Arabia and the wider GCC region with a mission to help people make their dreams come true by building the most customer-centric financial super-app o...Show moreLast updated: 22 days ago

Promoted

Associate Solutions Manager

ElucidataJunagadh, IN

Delhi / Bangalore (3 days in office).Elucidata is a TechBio Company headquartered in San Francisco.Our mission is to unleash personalized medicine using AI and multi-omics, multimodal data.Elucidata’...Show moreLast updated: 11 days ago

Promoted

Python Data Engineer

iVoyantJunagadh, IN

One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 1 day ago