Senior Data Engineer - Azure Databricks

Posting title : Sr. Data Engineer (Databricks)

Experience : 5+ Years

Location : Pune / Ahmedabad

Work mode : Hybrid

Primary skills : Databricks, Data Modelling / Data Lakehouse, SQL, Python / Scala, Azure Data Factory (ADF) / AWS Glue

Qualification : Any Technical Degree

Roles & Responsibilities :

• Data Architecture & Development : Lead the design, development, and optimization of scalable, secure, and high-performance data solutions in Databricks.
• ETL / ELT Pipeline Engineering : Build and maintain robust pipelines, integrating Databricks with Azure Data Factory (or AWS Glue), ensuring reliability and efficiency.
• Advanced Analytics & AI Integration : Implement machine learning models and Generative AI-powered solutions to deliver business innovation.
• Collaboration : Partner with data scientists, analysts, and business teams to translate requirements into technical designs and deliverables.
• Data Quality & Governance : Enforce best practices for data validation, governance, and security to ensure trust and compliance.

Technical Leadership : Mentor junior engineers, conduct code reviews, and foster a culture of continuous learning.

Innovation & Research : Stay current with the latest trends in Databricks, Azure Data Factory, cloud platforms, and AI / ML to recommend and implement improvements.

Required Qualifications :

1. Data modelling, Data Lakehouse architectures, and ELT / ETL processes

2. SQL and at least one programming language (Python or Scala)

Preferred Skills :

(ref : hirist.tech)