Azure Data Engineer

Azure Data Engineer - 6 Month+ Rolling Contract

Market Day Rate on offer

Remote - (Sunday to Thursday working days)

Location : Remote - 1 Week per quarter in Qatar

Paritas is working with a global IT Consultancy & leading Energy client who are seeking an experienced and highly skilled Azure Data Engineer to join their team who is responsible for data engineering, designing, developing, and maintaining the data platform and systems required for data storage, processing, and analysis.

Responsibilities

Design, develop, and implement data solutions using Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Event Hub, and other Azure services.

Build and maintain efficient data pipelines and ETL processes to support data integration and analysis.

Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.

Optimize and tune data processes for performance, reliability, and scalability.

Ensure data security and compliance with industry standards and regulations.

Troubleshoot and resolve data-related issues and discrepancies.

Create and maintain documentation for data solutions, including architecture diagrams, data flow diagrams, and technical specifications.

Stay up-to-date with the latest Azure technologies and best practices for data engineering.

Required Skills

8+ years of experience as an Azure Data Engineer or similar role.

Strong expertise in Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Event Hub.

Proficiency in programming languages such as PySpark, Scala, or SQL.

Experience with data modeling, data warehousing, and big data technologies.

Knowledge of Delta Lake and other data storage formats.

Familiarity with data integration tools and techniques.

Excellent problem-solving skills and attention to detail.

Knowledge of data governance and data quality best practices.

Strong communication and collaboration skills.

Certification in Microsoft Azure Data Engineering or related areas is a plus

Bachelor’s degree in Computer Science, Information Technology, or a related field.