Key Responsibilities :
- Architect, design, and implement high-volume ETL pipelines for batch and real-time data integration using Microsoft Fabric, Azure Data Factory, Databricks (including Unity Catalog), Azure Functions, Synapse Analytics, Data Lake, Delta Lake, and Azure SQL Database.
- Optimize Databricks clusters and manage workflows to ensure cost efficiency and high performance.
- Lead data modeling, governance, data quality management, and modernization initiatives.
- Develop architecture blueprints, technical designs, and documentation for scalable, secure Azure-based data solutions.
- Provide technical leadership and best practice guidance on cloud architecture, data integration, and Azure Fabric technologies.
- Stay current with emerging Azure services and Microsoft Fabric advancements, recommending system improvements.
- Lead Proof of Concepts (PoCs) and drive agile delivery methodologies for solution development and implementation.
- Collaborate with cross-functional teams, mentor junior engineers, and manage stakeholder communications effectively.
Required Skills & Experience :
12+ years of hands-on experience in Microsoft Azure Data Engineering with a strong focus on analytical and large-scale data projects.Extensive expertise in Microsoft Fabric, Azure Data Factory, Databricks with Unity Catalog, Synapse Analytics, Delta Lake, Azure Functions, and Azure SQL Database.Strong experience in designing, building, and optimizing ETL pipelines and workflows for complex data models and real-time data integration.Proven skills in Databricks cluster optimization and cost-effective resource management.Deep understanding of data modeling, data governance frameworks, data quality standards, and data modernization best practices.Experience creating technical design documentation and architecture blueprints for cloud data solutions.Excellent leadership skills with experience guiding teams and delivering large-scale projects using agile methodologies.Strong communication and stakeholder management skills.Preferred Qualifications :
Relevant Microsoft Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect).Experience with cloud security and compliance best practices.(ref : hirist.tech)