This job offer is not available in your country.

Data Engineer (Databricks)

Marx Enterprise Transformation ArchitectureKolhapur, IN

12 days ago

Job description

Azure Data Engineer – Databricks & Data Fabric

Experience : 5+ years in Data Engineering, 3+ years on Azure stack

Job Overview :

We are seeking an experienced Azure Data Engineer with strong hands-on expertise in Azure Databricks and Azure Data Fabric to support data transformation, integration, and analytics initiatives in a scalable cloud environment. The ideal candidate will be responsible for building modern data pipelines, optimizing data flows, and enabling robust data governance and observability using Microsoft’s data platform services.

Key Responsibilities :

Design, build, and manage ETL / ELT pipelines using Azure Data Factory and Azure Databricks
Implement and manage data flows across Azure Data Fabric , ensuring consistency and discoverability
Work with structured and unstructured data across on-prem and cloud sources
Collaborate with data architects, analysts, and business users to understand requirements and deliver high-quality data solutions
Optimize and scale data pipelines using PySpark and Delta Lake
Monitor, troubleshoot, and improve data pipeline performance using Azure Monitor and Log Analytics
Ensure data security, governance, and compliance practices across all data flows
Contribute to architectural decisions and cloud modernization strategy

Required Skills & Experience :

Strong experience with Azure Databricks , PySpark , and Delta Lake

Hands-on with Azure Data Factory (ADF) and Dataflows

Solid understanding of Azure Data Fabric concepts and implementation

Experience working with Azure Synapse Analytics , ADLS Gen2 , and Azure SQL

Proficiency in SQL and Python

Knowledge of DevOps practices and CI / CD using Azure DevOps or GitHub

Familiarity with data governance , metadata management , and cataloging

Good understanding of data modeling , data security , and compliance (GDPR, HIPAA)

Nice-to-Have :

Experience with Power BI , Azure Purview , or Microsoft Fabric

Exposure to Snowflake or other modern cloud data platforms

Azure certification : DP-203 – Azure Data Engineer Associate or equivalent

Create a job alert for this search

Data Engineer • Kolhapur, IN