Hands on Databricks / ADF / Python / Pyspark
Must Have
- Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python / PySpark
- Proficient with Databricks & Python
- Senior developers with Full Database / Datawarehouse / DataMart development capabilities
- Senior SME with SQL Server required.
- Proficiency with standard file formats and markup language technology such as JSON, XML, XSLT.
- Proficiency with Azure Cloud data environments highly desired.
- Excellent verbal communication skills. Good problem-solving skills. Attention to detail.
- Proficiency with Data Warehousing principals and design
Nice to have
Familiarity with oData Services / Kafka / Azure Data FactoryFamiliarity with Terraform, Unity CatalogFamiliarity with other database technology such as Mongo, Cosmos, MySQL or Oracle a plusSkills Required
Azure Data Factory, Pyspark, Sql Server, Xml, Azure Databricks, Data Warehousing, Json, Xslt, Python