Sr lead Azure Data engineer

Sr lead Azure Data engineer

Location : Mumbai , Pune , Bangalore , Chennai, Noida

Experience

: relevant 10 + yrs to 15 yrs , lead experience mandate minimum 2 yrs

Sr. Software Engineer-Data engineer requirements :

Will be responsible for creating and maintaining automated ETL pipelines and data using the Azure suite. They will be responsible for moving and transforming data using dataflows and Python scripts within Azure Data Factory. Proficiency with Python, SQL, Azure Data Factory, Git, and DevOps are required, as is working with the wider Azure platform. Experience with CI / CD and the building of deployment pipelines using YAML and PowerShell templates is preferred.

They will be required to contribute to data modelling and testing, as well as for the debugging of pipelines and ensuring the reliability of data workflows. The engineer will be required to integrate data from different sources and systems, and requires experience with API data extraction.

Technical Skills : Python

SQL

Azure Data Factory

Git (DevOps)

Data Modelling

Data pipeline testing and debugging

Data validity testing

API data extraction

CI / CD - YAML (preferred)

Azure Synapse