Azure Data Engineer

Candidate should have :

Background in processing and managing large data sets

Strong knowledge of Structured Query Language (SQL)

Experience building data pipelines using Azure Databricks and Azure Data Factory

Knowledge of analytics platform including Azure store, Azure Data Lake, Azure SQL DW / Synapse, Azure Stream Analytics

Experience with Databricks Delta tables and Databricks optimization (clusters, code, etc)

Strong coding skills in PySpark – working with data frames, reading from different sources, and writing to different resources

Bachelor’s degree in Computer Science or a related analytical field or equivalent experience is preferred.

5+ years of IT experience

2 years of experience in Azure Platform

Familiarity with Terraform and Azure DevOps

Strong coding skills in Python

A high degree of self-motivation, commitment, and integrity

Ability to deal with some levels of ambiguity

Excellent communication skills (written and verbal), as well as an ability to follow standards