Data Engineering Manager - AI & Automation (7 to 12 Years)

Data Engineering Manager – AI & Automation

Experience : 7 to 12 Years

Location :

Remote (Work from Home) / Bangalore / India

Mode of Engagement : Full-time

No of Positions :

Educational Qualification :

MBA / B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry :

IT / Data / AI / E-commerce / FinTech / Healthcare

Notice Period : Immediate

What We Are Looking For :

7–12 years of experience in managing

end-to-end data engineering and delivery projects

, including

Python-based data scraping, ETL, and dashboarding

Proven experience in

leading teams

setting up complex data engineering projects

, and establishing

data pipelines

integrating scraping, processing, and analytics.

Hands-on proficiency in

Python, SQL, ETL frameworks

, and

web scraping

, with working knowledge of

AI tools and automation frameworks

like

LangChain, LlamaIndex, or AutoGen

Experience with

AWS, GitHub, CI / CD, Jira, ClickUp

, and

DevOps tools

for delivery tracking, workflow automation, and performance optimization.

Responsibilities :

Lead and manage multiple

data engineering and AI-enabled delivery projects

, ensuring scalability, performance, and high-quality outcomes.

Architect and implement

data pipelines and scraping systems

using Python, Pandas, BeautifulSoup, or Scrapy, integrating

AI-based automation

where applicable.

Collaborate with cross-functional teams — Data Engineers, Python Developers, and Analysts — to

design, build, and optimize

large-scale data systems and dashboards.

Drive

automation and AI adoption

across projects to improve efficiency in

scraping, transformation, and reporting workflows

Work closely with clients across

IT, FinTech, E-commerce, and Healthcare

domains to understand technical needs, plan delivery schedules, and ensure data integrity.

Establish and monitor

data quality, governance, and compliance

standards throughout project execution.

Mentor and guide team members on

Python best practices, AI frameworks, and data engineering design patterns

Manage project timelines, status reporting, and delivery metrics using

Jira, ClickUp, and CI / CD pipelines

Qualifications :

Bachelor's or master's degree in engineering, Computer Science, or related field.

Strong hands-on expertise in

Python, SQL, ETL, Advanced Excel, Power BI, and web scraping frameworks

Exposure to

AI and automation frameworks

(LangChain, LlamaIndex, AutoGen) preferred.

Working knowledge of

AWS

GitHub

DevOps (Docker, Kubernetes)

, and

workflow automation tools

Proven experience managing

cross-functional data delivery teams

and handling

international client communication

Excellent analytical, leadership, and problem-solving skills.

Project Management certifications (

PMP, Agile, or Scrum Master

) are an added advantage.