Job Title : Senior Azure Data Engineer
Experience : 9–12 Years
Location : Noida
Job Description
We are looking for a Senior Azure Data Engineer with extensive experience in building and optimizing large-scale data pipelines and architectures using the Microsoft Azure ecosystem . The ideal candidate should have deep hands-on expertise in Azure Data Factory (ADF) , Azure Databricks , and Unity Catalog , along with a strong understanding of data governance, security, and performance optimization .
The role involves designing scalable, reliable, and secure data platforms that enable data-driven decision-making across the enterprise.
Key Responsibilities
- Design and implement end-to-end data pipelines using Azure Data Factory (ADF) and Azure Databricks.
- Manage data ingestion, transformation, and orchestration across multiple sources and destinations.
- Implement Delta Lake architecture and manage data governance through Unity Catalog.
- Collaborate with data architects and business teams to define data integration strategies.
- Optimize pipelines for performance, scalability, and cost efficiency.
- Ensure data security, lineage, and cataloging across environments.
- Work closely with stakeholders to define and maintain data models and ETL / ELT frameworks.
- Implement and maintain CI / CD pipelines for data workflows using Azure DevOps or GitHub Actions.
- Drive best practices in data management, quality, and compliance.
- Mentor junior engineers and provide technical guidance on Azure data solutions.
Technical Skills
Core Azure Tools & Services :
Azure Data Factory (ADF) : Pipeline orchestration, triggers, integration runtimesAzure Databricks : PySpark, Delta Lake, Notebooks, job orchestrationUnity Catalog : Data governance, access control, lineage, complianceAzure Synapse Analytics and Azure SQL DatabaseProgramming & Scripting
Strong proficiency in SQL and Python (PySpark)Experience with ETL / ELT design patternsData Storage & Architecture
Azure Data Lake Storage (ADLS Gen2), Delta Lake, Parquet / CSV / JSON data formatsData modeling (star / snowflake schema)DevOps & Automation
CI / CD pipelines using Azure DevOps / GitHubVersion control (Git)Infrastructure as Code (IaC) : Terraform / ARM Templates (optional but preferred)Other Preferred Skills
Knowledge of Power BI / Data Visualization toolsExperience with data quality frameworksFamiliarity with Data Mesh / Modern Data Platform conceptsSkills Required
Github, ARM Templates, Power Bi, Csv, Pyspark, Azure Databricks, Json, Sql, Git, Terraform, Azure Synapse Analytics, Python, Azure Devops