Azure Bigdata Specialist

Must Have Skills :

• Azure Databricks (ADB) : Extensive experience working with Databricks, Delta Lake, and Azure Data Lake Storage (ADLS).
• Azure Data Factory (ADF) : Experience in building ELT / ETL pipelines in a Spark-based environment.
• SQL and Databases : Proficiency with Azure SQL Database (SQL DB) and strong SQL skills.
• Spark & PySpark : Extensive experience with SparkCore , PySpark , SparkSQL , Scala .
• Data Storage : Hands-on experience with Azure Blob Storage and Delta Lake .
• Real-Time Data Processing : Experience in Apache Kafka , EventHub , IoT , Structured Streaming , and Stream Analytics .
• ELT Orchestration : Familiarity with Apache Airflow for managing ELT workflows.
• Infrastructure Management : Experience with Infrastructure as Code (IaC) using tools like Terraform .
• CI / CD & Version Control : Experience with CI / CD pipelines, version control tools like GitHub , and Azure DevOps .

Good to Have :

Qualifications :

Certifications (Preferred) :

Skills Required

Pyspark, Sparksql, Sql