PySpark, Azure Databricks, ADF, Azure Synapse

Detailed JD (Roles and Responsibilities)

• Design and develop scalable ETL pipelines using Azure Databricks, PySpark, and Azure Data Factory to ingest, transform, and integrate data from multiple internal and external sources.
• Ensure data quality, consistency, and reliability across complex data workflows and large-scale datasets.
• Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver efficient data solutions.
• Optimize data processing performance and implement best practices for data engineering in cloud environments.
• Work in Agile development environments, contributing to sprint planning, reviews, and continuous integration and delivery cycles.
• Good understanding of retail or consumer business process will be a plus
• Experience in working in Agile project development

Very strong communication skills and client management skills.

Total Experience

6+ Years

Relevant Experience

5+ Years

Mandatory skills

PySpark, Azure Databricks, ADF, Azure Synapse.

Desired skills

SQL

Domain (Industry)

Retail – Media Campaign data Analytics