Colan Infotech - Azure Data Engineer - PySpark / Python

Position : Azure Data Engineer

Experience : 3-5 Years

Job Type : Full-time

Job Summary :

We are seeking a skilled Azure Data Engineer with 3-5 years of experience to design, develop, and maintain scalable data pipelines within the Microsoft Azure ecosystem.

The ideal candidate will have strong expertise in Azure Data Factory, Azure Databricks, PySpark / Scala Spark, and Python.

This role is critical for building efficient ETL processes, optimizing data workflows, and ensuring high-quality, reusable code to support business analytics and reporting needs.

Key Responsibilities :

Data Pipeline Development :

• Design, develop, and maintain robust and scalable data pipelines, primarily utilizing PySpark / Scala Spark, Python, Azure Databricks, and Azure Data Factory.

Code Quality & Optimization :

Azure Platform Expertise :

ETL / ELT Best Practices :

Data Storage & Services :

Collaboration & Documentation :

Maintenance & Troubleshooting :

Qualifications :

Experience : 3-5 years of professional experience as a Data Engineer, with a focus on Azure Cloud.

Mandatory Technical Stack : Strong proficiency in PySpark / Scala Spark, Python, Azure Databricks, and Azure Data Factory.

Data Management : Experience with Azure data storage solutions, specifically Azure Blob Storage and Data Lake Storage.

Query Optimization : Expertise in writing and optimizing complex SQL queries for performance tuning.

Process : Solid understanding of ETL / ELT methodologies and best practices for building production-grade data solutions.

Preferred Skills :

(ref : hirist.tech)