Data Engineer – Azure & AWS

Job Description

We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands-on experience with modern data engineering tools and cloud platforms, particularly in Azure and AWS ecosystems.

Key Responsibilities

• Design, develop, and maintain data pipelines using PySpark and Python.
• Build and optimize data workflows in Azure Synapse Analytics and Azure Data Factory.
• Manage and organize data storage in Azure Data Lake Storage (ADLS) and AWS S3.
• Develop and maintain scalable data solutions using Databricks.
• Write efficient and optimized SQL queries for data extraction, transformation, and analysis.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
• Ensure data quality, integrity, and security across all data platforms.
• Monitor and troubleshoot data pipelines and workflows.

Required Technical Skills

Programming Languages : Proficiency in Python and PySpark.

Cloud Platforms :

Databases & Querying : Strong command of SQL for data manipulation and analysis.

Version Control : Experience with Git or similar tools.

CI / CD & Automation : Familiarity with automated deployment and testing of data pipelines.