Azure Data Engineer – Databricks & Data Fabric
Experience : 5+ years in Data Engineering, 3+ years on Azure stack
Job Overview :
We are seeking an experienced Azure Data Engineer with strong hands-on expertise in Azure Databricks and Azure Data Fabric to support data transformation, integration, and analytics initiatives in a scalable cloud environment. The ideal candidate will be responsible for building modern data pipelines, optimizing data flows, and enabling robust data governance and observability using Microsoft’s data platform services.
Key Responsibilities :
- Design, build, and manage ETL / ELT pipelines using Azure Data Factory and Azure Databricks
- Implement and manage data flows across Azure Data Fabric , ensuring consistency and discoverability
- Work with structured and unstructured data across on-prem and cloud sources
- Collaborate with data architects, analysts, and business users to understand requirements and deliver high-quality data solutions
- Optimize and scale data pipelines using PySpark and Delta Lake
- Monitor, troubleshoot, and improve data pipeline performance using Azure Monitor and Log Analytics
- Ensure data security, governance, and compliance practices across all data flows
- Contribute to architectural decisions and cloud modernization strategy
Required Skills & Experience :
Strong experience with Azure Databricks , PySpark , and Delta LakeHands-on with Azure Data Factory (ADF) and DataflowsSolid understanding of Azure Data Fabric concepts and implementationExperience working with Azure Synapse Analytics , ADLS Gen2 , and Azure SQLProficiency in SQL and PythonKnowledge of DevOps practices and CI / CD using Azure DevOps or GitHubFamiliarity with data governance , metadata management , and catalogingGood understanding of data modeling , data security , and compliance (GDPR, HIPAA)Nice-to-Have :
Experience with Power BI , Azure Purview , or Microsoft FabricExposure to Snowflake or other modern cloud data platformsAzure certification : DP-203 – Azure Data Engineer Associate or equivalent