Mandatory skills- Python+ Azure Databricks + SQL (all are mandatory skills)
Key responsibilities :
Build
reusable utilities , templates, and automation pipelines.
Design scalable
data engineering frameworks , standards, and best practices.
Provide architectural guidance,
cost optimization and performance tuning support
for Data Engineering solutions (mainly on Azure)
Evaluate and onboard new features(in Databricks and others) for organization-wide adoption.
Support data governance and access control standardization (Unity Catalog, Purview etc.)
Required technical skills
Mandatory :
Strong expertise in Python and PySpark
Hands-on with Databricks, Delta Lake, and Apache Spark, SQL
Familiar with CI / CD, Git,
Working knowledge of cloud platforms (Good to have somebody who has knowledge on both Azure and GCP )
Good understanding of Unity catalog, Lakehouse architecture and data security.
Senior Data • Surat, Gujarat, India