Senior Data Engineer

Senior Data Engineer

Azure Data Engineer (ADB, ADF)

Tech Skills –

Strong expertise in Azure data factory,Azure databricks,Azure datalake and Azure storage

Proficiency SQL,ADF,ADB, Synapse,Fabric(Optional) in python(Optional),pyspark(Optional)

Experience in designing ETL / ELT pipelines and optimizing Spark jobs for large datasets.

Experience with Azure SQL Database, Managed Instance and Delta lake

New) CI / CD for Data Pipelines- Using Azure Devops or GitHub actions automated deployment

New)Data Security & Governance- Implement RBAC, encryption and Compliance measures

New and nice to have) Experience in Power BI – Building data models , report and dashboards

Key Responsibilities –

Desing & implement scalable data pipelines

Design and implement scalable data pipelines using Azure Data Factory for ETL / ELT processes.

Develop data workflows to integrate data from various sources (on-premise,cloud)into Azure data storage solutions such as Data Lake,SQL Database.