Data Engineering Manager (AWS Databricks)
BlendHyderabad, India13 days ago
Job descriptionBachelor's or master's degree in computer science, Engineering, or a related field. 8+ years of hands-on experience in data engineering, with at least 3 years working with AWS Databricks. Strong programming skills in Python for data processing and automation. Advanced proficiency in SQL for querying and transforming large datasets. Deep experience with Apache Spark / PySpark in a distributed computing environment. Solid understanding of data modelling, warehousing, and performance optimization techniques. Proficiency with AWS services such as Glue, S3, Lambda and EMR. Experience with version control Git or Code commit Experience in any workflow orchestration like Airflow, AWS Step functions is a plus. Excellent communication and stakeholder management skills with a strategic mindset.
We are looking for an experienced Data Engineering Manager with a strong foundation in Python, SQL, and Spark, and hands-on expertise in AWS, Databricks. In this role, you will build and maintain scalable data pipelines and architecture to support analytics, data science, and business intelligence initiatives. You’ll work closely with cross-functional teams to drive data reliability, quality, and performance.
Responsibilities :
- Design, develop, and optimize scalable data pipelines using Databricks in AWS such as Glue, S3, Lambda, EMR, Databricks notebooks, workflows and jobs.
- Building data lake in WS Databricks.
- Build and maintain robust ETL / ELT workflows using Python and SQL to handle structured and semi-structured data.
- Develop distributed data processing solutions using Apache Spark or PySpark.
- Partner with data scientists and analysts to provide high-quality, accessible, and well-structured data.
- Ensure data quality, governance, security, and compliance across pipelines and data stores.
- Monitor, troubleshoot, and improve the performance of data systems and pipelines.
- Participate in code reviews and help establish engineering best practices.
- Mentor junior data engineers and support their technical development.
Requirements :
Create a job alert for this search
Manager Data Engineering • Hyderabad, India
Related jobs
- Promoted
- New!
Engineering Manager
HiLabsHyderabad, IN We are looking for an experienced Data Engineering Manager to lead and scale our data engineering function.The ideal candidate will be responsible for designing, building, and maintaining high-qual...Show moreLast updated: 12 hours ago
- Promoted
Data Engineering Manager
Accordion IndiaHyderabad, Republic Of India, IN Accordion is a global private equity-focused financial consulting firm specializing in driving value creation through services rooted in Data & Analytics and powered by technology.Accordion works a...Show moreLast updated: 13 days ago
- Promoted
Cushman & Wakefield - Manager - Data Engineering & Analytics
Cushman Wakefield India Pvt LtdHyderabad Job Title : Manager - Data Engineering & Analytics Job Description Summary : Cushman & Wakefie...Show moreLast updated: 30+ days ago
- Promoted
Data Engineering Manager
Insight GlobalHyderabad, Telangana, India The Data & Insights organization at Insight Global delivers Trusted Data & Verified Insights to drive strategic decision-making across the company.
As the first Data Engineering Manager based in Hyd...Show moreLast updated: 30+ days ago
- Promoted
- New!
Engineering Manager
Papaya GlobalHyderabad, IN Papaya Global is reinventing global payroll and workforce management.Our automated platform helps companies hire, onboard, manage, and pay people in more than 160 countries.In this role, you will h...Show moreLast updated: 12 hours ago
- Promoted
Senior AWS Data Engineer
CYAN360Hyderabad, IN Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
- Promoted
Data Engineering Manager (AWS Databricks)
BlendHyderabad, Telangana, India We are looking for an experienced.In this role, you will build and maintain scalable data pipelines and architecture to support analytics, data science, and business intelligence initiatives.You’ll...Show moreLast updated: 13 days ago
- Promoted
Engineering Manager - II, Data Engineering Platform
TamaraHyderabad, IN Data Engineering Manager II : Real-Time Data & Experimentation Platform (Remote, India).Saudi Arabia's first fintech unicorn.
GCC, with a mission to empower dreams through customer-centric financial ...Show moreLast updated: 16 days ago
- Promoted
Engineering Manager
The Transformation GroupHyderabad, IN We are partnering with our clients in the US to create something game-changing - a platform that redefines how digital products are built - faster, better, and with more impact than ever before.We ...Show moreLast updated: 1 day ago
- Promoted
- New!
Senior DataOps Engineer (AWS)
MSBC GroupHyderabad, IN Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show moreLast updated: 12 hours ago
- Promoted
Cloud Platform Engineering Manager
NationsBenefits IndiaHyderabad, Republic Of India, IN NationsBenefits is recognized as one of the fastest growing companies in America and a Healthcare Fintech provider of supplemental benefits, flex cards, and member engagement solutions.We partner w...Show moreLast updated: 30+ days ago
- Promoted
Senior Manager – Aws Connect Engineering
Blue Spire IncHyderabad, Republic Of India, IN Blue Spire is seeking an experienced.Lead / Senior Manager – AWS Connect Engineering & API Solutions.AWS Connect migration and modernization programs for our BFSI enterprise clients.This role requi...Show moreLast updated: 3 days ago
- Promoted
Senior Data Engineering Manager
Kanerika IncHyderabad, Republic Of India, IN Hyderabad, Indore and Ahmedabad (India).Develop and maintain data pipelines using Azure Data Factory (ADF) / Databricks for data integration and ETL processes.
Design, implement, and optimize Power B...Show moreLast updated: 23 days ago
- Promoted
Data Engineering Team Lead
Insight GlobalHyderabad, Republic Of India, IN The Data & Insights organization at Insight Global delivers Trusted Data & Verified Insights to drive strategic decision-making across the company.
As the first Data Engineering Manager based in Hyd...Show moreLast updated: 30+ days ago
- Promoted
Data Engineering Manager
BlendHyderabad, Republic Of India, IN We are looking for an experienced.In this role, you will build and maintain scalable data pipelines and architecture to support analytics, data science, and business intelligence initiatives.You’ll...Show moreLast updated: 13 days ago
- Promoted
Manager, Data Platform Engineering
Insight GlobalHyderabad, Republic Of India, IN The Data & Insights organization at Insight Global delivers Trusted Data & Verified Insights to drive strategic decision-making across the company.
As the first Data Engineering Manager based in Hyd...Show moreLast updated: 30+ days ago
- Promoted
Engineering Manager
vidaXLHyderabad, Republic Of India, IN Job Title : Tech Lead Salesforce (E-Commerce).Work Mode : Semi Hybrid Mode (4days work from office) and (1 day work from home(either Monday or Wednesday or Friday)) in a week.We are looking for an ex...Show moreLast updated: 30+ days ago
- Promoted
Project Manager – Data Engineering & Analytics
BrillioHyderabad, IN We are looking for a skilled Technical Project Manager to lead and deliver projects in data engineering and analytics.You will manage cross-functional teams to execute data platform, pipeline, and ...Show moreLast updated: 30+ days ago