Mandatory skills- Python+ Azure Databricks + SQL (all are mandatory skills)
Key responsibilities :
- Build reusable utilities , templates, and automation pipelines.
- Design scalable data engineering frameworks , standards, and best practices.
- Provide architectural guidance, cost optimization and performance tuning support for Data Engineering solutions (mainly on Azure)
- Evaluate and onboard new features(in Databricks and others) for organization-wide adoption.
- Support data governance and access control standardization (Unity Catalog, Purview etc.)
Required technical skills :
Mandatory : Strong expertise in Python and PySparkHands-on with Databricks, Delta Lake, and Apache Spark, SQLFamiliar with CI / CD, Git,Working knowledge of cloud platforms (Good to have somebody who has knowledge on both Azure and GCP )Good understanding of Unity catalog, Lakehouse architecture and data security.