Data Engineer

Job Description :

We are seeking a highly skilled 5+ Azure Data Engineer to design, develop, and optimize data pipelines and data integration solutions in a cloud-based environment. The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-solving skills.

Key Responsibilities :

Design and develop advanced ETL pipelines for data ingestion and egress for batch data.

Build scalable data solutions using Azure Data Factory (ADF) , Databricks , Spark (PySpark & Scala Spark) , and other Azure services.

Troubleshoot data jobs, identify issues, and implement effective root cause solutions.

Collaborate with stakeholders to gather requirements and propose efficient solution designs.

Ensure data quality, reliability, and adherence to best practices in data engineering.

Maintain detailed documentation of problem definitions, solutions, and architecture.

Work independently with minimal supervision while ensuring project deadlines are met.

Required Skills & Qualifications :

Microsoft Certified : Azure Fundamentals (preferred).

Microsoft Certified : Azure Data Engineer Associate (preferred).

Proficiency in SQL , Python , and Scala .

Strong knowledge of Azure Cloud services , ADF , and Databricks .

Hands-on experience with Apache Spark (PySpark & Scala Spark).

Expertise in designing and implementing complex ETL pipelines for batch data.

Strong troubleshooting skills with the ability to perform root cause analysis.

Soft Skills :

Excellent verbal and written communication skills.

Strong documentation skills for drafting problem definitions and solutions.

Ability to effectively gather requirements and propose solution designs.

Self-driven with the ability to work independently with minimal supervision.