Description :
Role : Sr.Azure Data Engineer
Job Summary :
We are seeking a highly skilled and experienced Sr. Azure Data Engineer to design, build, and optimize our next-generation data platform on Microsoft Azure.
This role requires 5+ years of dedicated experience with Azure data services, focusing heavily on Azure Synapse Analytics and Azure Data Factory (ADF).
The successful candidate will be a key contributor to developing scalable data ingestion pipelines, transforming complex data sets, and driving advanced analytics capabilities, with crucial expertise or exposure to Microsoft Fabric.
Core Responsibilities :
Azure Data Platform Development :
- Design, build, and maintain highly scalable and reliable ETL / ELT data pipelines using Azure Data Factory (ADF), including orchestration, monitoring, and error handling.
- Implement robust data warehousing solutions and complex analytical queries using Azure Synapse Analytics (SQL Pools, Serverless Pools, Spark Pools).
- Develop, optimize, and troubleshoot large-scale data transformation jobs using PySpark / Spark within the Azure ecosystem.
- Ensure security and governance are maintained across all data solutions deployed on Azure.
Microsoft Fabric and Modernization :
Apply knowledge and hands-on experience with Microsoft Fabric to evaluate, prototype, and implement unified data solutions (e.g., Lakehouse, Data Engineering components).Contribute to the modernization and migration strategy, transitioning legacy data systems to Azure Synapse and the Microsoft Fabric platform.Utilize Fabric components for efficient data governance and improved data consumption experiences.Data Modeling and Performance :
Design and implement optimal data models (dimensional, transactional) within Azure Synapse to support demanding business intelligence and reporting requirements.Performance tune data ingestion processes and query execution within ADF and Synapse to ensure efficient resource utilization and low latency.Write and optimize complex SQL queries for data integration and analysis.DevOps and Quality Engineering :
Implement CI / CD pipelines using Azure DevOps for automated deployment of ADF and Synapse artifacts.Follow established software engineering principles, conduct thorough code reviews, and create comprehensive technical documentation.Required Skills & Qualifications :
Experience : 5+ years of professional experience as a Data Engineer.
Cloud Platform : Expert proficiency in Microsoft Azure data services.
Core Tools : Deep, hands-on experience with Azure Synapse Analytics and Azure Data Factory (ADF).
Data Technologies : Strong proficiency in SQL and solid understanding of data warehousing concepts.
Fabric Knowledge : Expertise or strong familiarity with the Microsoft Fabric platform is highly required.
Preferred Skills :
Experience with Azure Databricks and PySpark programming.Proficiency in using Azure DevOps for CI / CD implementation.Knowledge of Azure Data Lake Storage (ADLS Gen2) architecture and optimization.Microsoft Azure Data Engineering certification (e.g., DP-203).Location & Logistics :
Location : Visakhapatnam, India
Mode : Permanent
(ref : hirist.tech)