Data Engineering Manager – AI & Automation (7 to 12 Years)

AIMLEAPKolkata, IN

1 day ago

Job description

Data Engineering Manager – AI & Automation

Experience : 7 to 12 Years

Location : Remote (Work from Home) / Bangalore / India

Mode of Engagement : Full-time

No of Positions : 2

Educational Qualification : MBA / B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / E-commerce / FinTech / Healthcare

Notice Period : Immediate

What We Are Looking For :

7–12 years of experience in managing end-to-end data engineering and delivery projects , including Python-based data scraping, ETL, and dashboarding .
Proven experience in leading teams , setting up complex data engineering projects , and establishing data pipelines integrating scraping, processing, and analytics.
Hands-on proficiency in Python, SQL, ETL frameworks , and web scraping , with working knowledge of AI tools and automation frameworks like LangChain, LlamaIndex, or AutoGen .
Experience with AWS, GitHub, CI / CD, Jira, ClickUp , and DevOps tools for delivery tracking, workflow automation, and performance optimization.

Responsibilities :

Lead and manage multiple data engineering and AI-enabled delivery projects , ensuring scalability, performance, and high-quality outcomes.

Architect and implement data pipelines and scraping systems using Python, Pandas, BeautifulSoup, or Scrapy, integrating AI-based automation where applicable.

Collaborate with cross-functional teams — Data Engineers, Python Developers, and Analysts — to design, build, and optimize large-scale data systems and dashboards.

Drive automation and AI adoption across projects to improve efficiency in scraping, transformation, and reporting workflows .

Work closely with clients across IT, FinTech, E-commerce, and Healthcare domains to understand technical needs, plan delivery schedules, and ensure data integrity.

Establish and monitor data quality, governance, and compliance standards throughout project execution.

Mentor and guide team members on Python best practices, AI frameworks, and data engineering design patterns .

Manage project timelines, status reporting, and delivery metrics using Jira, ClickUp, and CI / CD pipelines .

Qualifications :

Bachelor's or master's degree in engineering, Computer Science, or related field.

Strong hands-on expertise in Python, SQL, ETL, Advanced Excel, Power BI, and web scraping frameworks .

Exposure to AI and automation frameworks (LangChain, LlamaIndex, AutoGen) preferred.

Working knowledge of AWS , GitHub , DevOps (Docker, Kubernetes) , and workflow automation tools .

Proven experience managing cross-functional data delivery teams and handling international client communication .

Excellent analytical, leadership, and problem-solving skills.

Project Management certifications ( PMP, Agile, or Scrum Master ) are an added advantage.

Create a job alert for this search

Manager Data Engineering • Kolkata, IN

Related jobs

Promoted

Engineering Manager - Data Platform

CoinbaseKolkata, IN

Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 2 days ago

Promoted

Data Engineering Azure databricks

EXLKolkata, IN

Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Work with stakeholders to unders...Show moreLast updated: 24 days ago

Promoted

Engineering Manager AI & Automation [T500-20547]

ANSRkolkata, west bengal, in

Headquartered in Berlin, Germany, 4flow provides consulting, software and services for logistics and supply chain management. More than 1300 team members leverage their supply chain expertise and IT...Show moreLast updated: 29 days ago

Promoted

GEN AI Architect

IMR Soft LLCKolkata, IN

Bangalore, Chennai, Hyderabad, Pune – Remote.AI Solution Designer and Implementor.We are seeking a highly skilled and visionary AI Solution Designer and Implementor to lead the design, development,...Show moreLast updated: 7 days ago

Promoted
New!

Data Engineering Manager - Python & AI (7 to 12 yrs)

AIMLEAPKolkata, IN

Data Engineering Manager – Python & AI.Remote (Work from Home) / Bangalore / India .Tech / MCA / Computer Science / IT .IT / Data / AI / E-commerce / FinTech / Healthcare .Python-based data scrapin...Show moreLast updated: 22 hours ago

Promoted

Assistant Manager - GenAi

iMerit TechnologyKolkata, West Bengal, India

Assistant Manager – Generative AI ( Projects).Join our dynamic team at the forefront of Generative AI innovation.AI data annotation, training, and linguistic solutions, empowering industry-leading ...Show moreLast updated: 8 days ago

Promoted

AI / ML Engineer

LingaroKolkata, IN

AI / ML Engineer – Senior Consultant.AI Engineering Group is part of Data Science & AI Competency Center and is focusing technical and engineering aspects of DS / ML / AI solutions.We are looking for exp...Show moreLast updated: 30+ days ago

Promoted

Senior AI Engineer

Nous InfosystemsKolkata, IN

Nous Infosystems is a CMMI® Level 5 and ISO 9001 : 2000 certified global information Technology Company with expertise in providing quality software solutions and IT-enabled support services to a wid...Show moreLast updated: 9 days ago

Promoted

Engineering Manager

AiPriseKolkata, IN

The ideal candidate will be responsible for managing and inspiring his or her team to achieve their performance metrics.Your role will involve strategizing, project management, part staff managemen...Show moreLast updated: 30+ days ago

Promoted

Engineering Manager

TamaraKolkata, IN

Tamara is the leading fintech platform in Saudi Arabia and the wider GCC region with a mission to help people make their dreams come true by building the most customer-centric financial super-app o...Show moreLast updated: 19 days ago

Promoted

AI and ML Architect - 5+ Years Experience

AdyatanTechKolkata, IN

We are seeking a highly skilled.The ideal candidate will combine deep technical expertise with strong leadership and architectural design capabilities. Design and architect end-to-end AI / ML solution...Show moreLast updated: 9 days ago

Promoted

Responsible AI

EXLKolkata, IN

We are seeking a highly skilled and principled Responsible AI Evaluator to assess, audit, and ensure the ethical development and deployment of AI models across the enterprise.This role spans tradit...Show moreLast updated: 30+ days ago

Promoted

AI Engineer

TalentBridgeKolkata, IN

Job Type : 6-Month Contract, after 6 months it will convert to fulltime.We are looking for an experienced AIML Engineer with 4–8 years of expertise in AI / ML solutions, specifically in building intel...Show moreLast updated: 7 days ago

Promoted

Associate Solutions Manager

ElucidataKolkata, IN

Delhi / Bangalore (3 days in office).Elucidata is a TechBio Company headquartered in San Francisco.Our mission is to unleash personalized medicine using AI and multi-omics, multimodal data.Elucidata’...Show moreLast updated: 9 days ago

Promoted

Manager, Boomi AI Solutions

RSM US LLPKolkata, IN

Job Description : Manager – Boomi AI Solutions.We are seeking a Manager – Boomi AI Solutions to help drive the development of AI-powered business solutions using the Boomi platform.This is a technic...Show moreLast updated: 9 days ago

Promoted

AI Delivery Manager / Project Manager

Innodata Inc.Kolkata, IN

We’re hiring a project manager to drive execution of custom-built AI solutions—including copilots, RAG systems, and agentic workflows. You’ll work closely with engineers, solution architects, and cl...Show moreLast updated: 7 days ago

Promoted

Engineering Manager

Branch InternationalKolkata, IN

Branch delivers world-class financial services to the mobile generation.With offices in the United States, Nigeria, Kenya, and India, Branch is a for-profit socially conscious company that uses the...Show moreLast updated: 30+ days ago

Promoted

Lead Engineer - AI / ML

Mindfire SolutionsKolkata, IN

As a Lead AI / ML Engineer, you spearhead the design, development, and implementation of advanced AI and machine learning models. Your role involves guiding a team of engineers ensuring the successful...Show moreLast updated: 30+ days ago