Senior Data Engineer

Role Senior Data Engineer 8 years of experience

Key responsibilities

Build reusable utilities templates and automation pipelines

Design scalable data engineering frameworks standards and best practices

Provide architectural guidance cost optimization and performance tuning support for Data Engineering solutions mainly on Azure

Evaluate and onboard new featuresin Databricks and others for organizationwide adoption

Support data governance and access control standardization Unity Catalog Purview etc

Required technical skills

Mandatory Strong expertise in Python and PySpark

Handson with Databricks Delta Lake and Apache Spark SQL

Familiar with CICD Git

Working knowledge of cloud platforms Good to have somebody who has knowledge on both Azure and GCP

Good understanding of Unity catalog Lakehouse architecture and data security

Mandatory Skills : Python for DATA,Apache Spark,Python,Data lakehouse Architecture,Databricks,Delta Lake