Experience in building ETL / data warehouse transformation processes Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks)Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala) Evaluating the performance and applicability of multiple tools against customer requirements Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.Coding complex U-SQL, Spark (Scala or Python). T-SQL Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks)Primary Skills : Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse
Skills Required
Azure Databricks, Hadoop, Hive, Pig, Impala, Etl, Data Warehouse