bigdata,azure databricks

Roles & Responsibilities :

• Tot - 6+ yrs
• Relevant required 4+ years of experience as lead developer with Datawarehouse, Big data and Hadoop implementation in Azure environment
• Participate in design and implementation of the analytics architecture.
• Experience in working on Hadoop Distribution, good understanding of core concepts and best practices
• Good experience in building / tuning Spark pipelines in Python / Java / Scala
• Good experience in writing complex Hive queries to drive business critical insights
• Understanding of Data Lake vs Data Warehousing concepts
• Experience with AWS Cloud, exposure to Lambda / EMR / Kinesis will be good to have

Skills Required

Azure Databricks, Databricks, Notebooks, Bigdata