Lead Engineer - Azure Databricks

Description :

Job Title : Lead Engineer

Location : Viman Nagar, Pune (Hybrid)

Company : UK-Based (Confidential)

Experience : 8 - 15 Years

Open Positions : 2

About the Role :

We are seeking a highly skilled Lead Data Engineer with deep expertise in Databricks, Apache Spark, and advanced SQL. In this role, you will be responsible for architecting, designing, and scaling modern data pipelines within a lakehouse environment. You will guide engineering teams, define best practices, and collaborate with cross-functional stakeholders to deliver high-quality, reliable, and scalable data solutions.

Key Responsibilities :

1. Data Engineering & Pipeline Development :

• Design, build, and optimize data pipelines using Databricks, Spark, and SQL.
• Implement scalable and high-performance ETL / ELT workflows for structured and unstructured data.
• Ensure data pipelines meet enterprise-level requirements for performance, reliability, and availability.
• Develop reusable frameworks, components, and automation scripts to streamline data engineering tasks.

2. Architecture & Technical Leadership :

3. Collaboration & Stakeholder Management :

4. Mentoring & Team Development :

Required Skills & Qualifications :

Good to Have (Optional) :

Interview Process :

(ref : hirist.tech)