Mandatory skills- Python+ Azure Databricks + SQL (all are mandatory skills)
Key responsibilities :
Build reusable utilities , templates, and automation pipelines.
Design scalable data engineering frameworks , standards, and best practices.
Provide architectural guidance, cost optimization and performance tuning support for Data Engineering solutions (mainly on Azure)
Evaluate and onboard new features(in Databricks and others) for organization-wide adoption.
Support data governance and access control standardization (Unity Catalog, Purview etc.)
Required technical skills :
Mandatory : Strong expertise in Python and PySpark
Hands-on with Databricks, Delta Lake, and Apache Spark, SQL
Familiar with CI / CD, Git,
Working knowledge of cloud platforms (Good to have somebody who has knowledge on both Azure and GCP )
Good understanding of Unity catalog, Lakehouse architecture and data security.
Senior Data • Palakkad, Kerala, India