PySpark, Azure Databricks, ADF, Azure Synapse

Detailed JD (Roles and Responsibilities)

Design and develop scalable ETL pipelines using Azure Databricks, PySpark, and Azure Data Factory to ingest, transform, and integrate data from multiple internal and external sources.

Ensure data quality, consistency, and reliability across complex data workflows and large-scale datasets.

Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver efficient data solutions.

Optimize data processing performance and implement best practices for data engineering in cloud environments.

Work in Agile development environments, contributing to sprint planning, reviews, and continuous integration and delivery cycles.

Good understanding of retail or consumer business process will be a plus

Experience in working in Agile project development

Very strong communication skills and client management skills.

Total Experience

6+ Years

Relevant Experience

5+ Years

Mandatory skills

PySpark, Azure Databricks, ADF, Azure Synapse.

Desired skills

SQL

Domain (Industry)

Retail – Media Campaign data Analytics