Engineering Manager – Big Data & Databricks (MH Local)

Job Title :

Engineering Manager – Big Data, Azure & Databricks

Location : Remote

Employment Type : Full-time

Department :

Data Engineering / Technology

Experience :

8+ years (3+ years in a managerial role)

Salary - 30 LPA

About the Role :

We are seeking a highly experienced and strategic

Engineering Manager

with deep expertise in

Big Data platforms ,

Microsoft Azure , and

Databricks . The ideal candidate will lead a team of talented data engineers to design and deliver scalable data pipelines and analytics platforms, ensuring high performance, reliability, and security in a cloud-native environment.

Key Responsibilities :

Lead, mentor, and grow a team of data engineers working on large-scale distributed data systems.

Architect and oversee the development of end-to-end data solutions using

Azure Data Services

and

Databricks .

Collaborate with cross-functional teams including data science, analytics, product, and business stakeholders to understand requirements and deliver impactful data products.

Drive best practices in data engineering, coding standards, version control, CI / CD, and monitoring.

Ensure high data quality, governance, and compliance with internal and external policies.

Optimize performance and cost efficiency of data infrastructure in the cloud.

Stay current with industry trends, emerging technologies, and apply them to improve system architecture and team capabilities.

Required Skills & Qualifications :

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

8+ years of experience in software / data engineering with at least 3 years in a leadership or managerial role.

Proven hands-on experience with :

Big Data ecosystems

(Spark, Hive, Hadoop)

Azure Cloud Services

(Data Lake, Data Factory, Synapse Analytics, Blob Storage)

Databricks

(including Delta Lake, MLFlow, Unity Catalog)

Strong programming experience in

Python ,

Scala , or

Java .

Deep understanding of data modeling, ETL / ELT processes, and performance tuning.

Experience managing Agile teams and delivering complex projects on time.

Excellent problem-solving, leadership, and communication skills.

Preferred Qualifications :

Certification in Azure Data Engineer or Azure Solutions Architect.

Experience with data governance, security, and compliance (e.g., GDPR, HIPAA).

Familiarity with ML / AI workflows and collaboration with data science teams.