Position - Azure Data Engineer
Role - Data Engineer & Senior Data Engineer
Exp range - 4 Yrs to 10 Yrs
Position Type - Permanent FTE
Locations - Bengaluru, Chennai, Hyderabad
Company - Global Leader in Data Analytics, Cloud and AI
Notice Period - Serving or Immediate Joiners ONLY (Need joining in November or before 15-Dec)
Skills & Experience :
- 5+ years of overall technical experience, with a minimum of 2 years of hands-on experience with Microsoft Azure and Databricks .
- Proven experience delivering at least one end-to-end Data Lakehouse solution on Azure Databricks using the Medallion Architecture.
- Strong working knowledge of the Databricks ecosystem , including : PySpark, Notebooks, Structured Streaming, Unity Catalog, Delta Live Tables (DLT), Workflows, and SQL Warehouse.
- Advanced programming, unit testing, and debugging skills in Python and SQL.
- Hands-on experience with Azure-native services such as : Azure Data Factory, ADLS Gen2, Azure SQL Database, and Event Hub.
- Solid understanding of data modeling techniques , including both Dimensional and Third Normal Form (3NF) models.
- Exposure to developing LLM / Generative AI-powered applications.
- Must have excellent understanding of CI / CD workflows using Azure DevOps.
Role Responsibilities :
Design and implement scalable, metadata-driven frameworks for data ingestion, quality, and transformation across both batch and streaming datasets.Develop and optimize end-to-end data pipelines to process structured and unstructured data, enabling the creation of analytical data products.Build robust exception handling, logging, and monitoring mechanisms for better observability and operational support.Take ownership of complex modules and lead the development of critical data workflows and components.Provide guidance to data engineers and peers on best practices.Collaborate with cross-functional teams—including business consultants, data architects, scientists, and application developers—to deliver impactful analytics solutions.