Data Engineer – Azure & AWS

Job Description

We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands-on experience with modern data engineering tools and cloud platforms, particularly in Azure and AWS ecosystems.

Key Responsibilities

Design, develop, and maintain data pipelines using PySpark and Python.

Build and optimize data workflows in Azure Synapse Analytics and Azure Data Factory.

Manage and organize data storage in Azure Data Lake Storage (ADLS) and AWS S3.

Develop and maintain scalable data solutions using Databricks.

Write efficient and optimized SQL queries for data extraction, transformation, and analysis.

Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.

Ensure data quality, integrity, and security across all data platforms.

Monitor and troubleshoot data pipelines and workflows.

Required Technical Skills

Programming Languages : Proficiency in Python and PySpark.

Cloud Platforms :

Azure Synapse Analytics

Azure Data Factory

Azure Data Lake Storage (ADLS)

Databricks

AWS S3

Databases & Querying : Strong command of SQL for data manipulation and analysis.

Version Control : Experience with Git or similar tools.

CI / CD & Automation : Familiarity with automated deployment and testing of data pipelines.