Data Engineer - Azure Databricks / PySpark

Job Title : Data Engineer Azure Databricks / PySpark

Number of Openings : 1

Location : India (Hybrid)

Industry Domain : Retail Media Campaign Data Analytics

Role Overview

We are seeking a highly skilled Data Engineer with strong expertise in Azure Databricks, PySpark, and Azure Data Factory (ADF) . The role involves designing, developing, and optimizing scalable ETL pipelines, ensuring high-quality data integration, and supporting analytics initiatives for retail and consumer business use cases. The individual will work in an Agile environment with cross-functional teams and must possess excellent communication and client management skills.

Key Responsibilities

Design and develop scalable ETL pipelines using Azure Databricks, PySpark, and ADF for ingesting, transforming, and integrating data from multiple internal and external sources.

Ensure data quality, consistency, and reliability across complex data workflows and large-scale datasets.

Collaborate with data architects, analysts, and business stakeholders to gather requirements and deliver efficient data solutions.

Optimize data processing performance and implement best practices for cloud-based data engineering .

Contribute to Agile ceremonies (sprint planning, reviews, CI / CD).

Apply understanding of retail or consumer business processes (preferred).

Effectively manage client interactions with strong communication skills .

Must-Have Skills

PySpark

Azure Databricks

Azure Data Factory (ADF)

Azure Synapse

Good-to-Have Skills

SQL

Retail / Consumer Business process exposure

Experience Required

Total Experience : 6+ Years

Relevant Experience : 5+ Years

Other Details

Shift : No fixed shift, but requires a few hours overlap with UK timings

Work Setup : Hybrid