Talent.com
Azure Bigdata Specialist

Azure Bigdata Specialist

ConfidentialBengaluru / Bangalore
30+ days ago
Job description

Must Have Skills :

  • Azure Databricks (ADB) : Extensive experience working with Databricks, Delta Lake, and Azure Data Lake Storage (ADLS).
  • Azure Data Factory (ADF) : Experience in building ELT / ETL pipelines in a Spark-based environment.
  • SQL and Databases : Proficiency with Azure SQL Database (SQL DB) and strong SQL skills.
  • Spark & PySpark : Extensive experience with SparkCore , PySpark , SparkSQL , Scala .
  • Data Storage : Hands-on experience with Azure Blob Storage and Delta Lake .
  • Real-Time Data Processing : Experience in Apache Kafka , EventHub , IoT , Structured Streaming , and Stream Analytics .
  • ELT Orchestration : Familiarity with Apache Airflow for managing ELT workflows.
  • Infrastructure Management : Experience with Infrastructure as Code (IaC) using tools like Terraform .
  • CI / CD & Version Control : Experience with CI / CD pipelines, version control tools like GitHub , and Azure DevOps .

Good to Have :

  • Containerization : Knowledge of Docker and Kubernetes .
  • Agile Methodology : Experience working in Agile environments.
  • Qualifications :

  • Education : BE , MS , M.Tech , or MCA .
  • Certifications (Preferred) :

  • Azure Big Data certification.
  • Databricks Certified Associate
  • Skills Required

    Pyspark, Sparksql, Sql

    Create a job alert for this search

    Azure Specialist • Bengaluru / Bangalore