Talent.com
Lead Data Engineer
Lead Data Engineerdunnhumby • Haryāna, Republic Of India, IN
Lead Data Engineer

Lead Data Engineer

dunnhumby • Haryāna, Republic Of India, IN
9 days ago
Job description

Retail Media is transforming how advertisers connect with consumers through personalized and targeted campaigns across retailers' digital and physical touchpoints. Retail Media Measurement plays a pivotal role in ensuring the effectiveness of these campaigns, driving value for advertisers, retailers, and consumers alike.

This role focuses on designing, building, and scaling solutions that enable the accurate measurement of retail media campaigns across various channels. By providing actionable insights, it empowers stakeholders to optimize media investments, improve ROI, and enhance the overall customer experience.

Job Title : Senior Data Engineer

Job Summary

We are looking for a talented and motivated Senior Data Engineer to contribute to the design, development, and optimization of real-time and batch data processing pipelines for our retail media measurement solution. In this role, you will work with tools such as Python, Apache Spark, and streaming frameworks to process and analyze data, supporting near-real-time decision-making for critical business applications in the retail media space.

You will collaborate with cross-functional teams, including Data Scientists, Analysts, and Senior Engineers, to build robust and efficient data solutions. As a Data Engineer, you will focus on implementing scalable data pipelines under the guidance of senior team members while gaining hands-on experience with streaming and batch processing systems. Your contributions will help ensure the reliability and performance of our data infrastructure, driving impactful insights for the business. This role offers an excellent opportunity to grow your expertise in modern data engineering practices while working on cutting-edge technologies.

What We Expect From You :

Experience :

  • 7–9 years of experience as a Data Engineer.
  • Prior experience working with scalable architecture and distributed data processing systems

Technical Expertise :

  • Strong programming skills in SQL and PySpark .
  • Proficiency in big data solutions such as Apache Spark and Hive .
  • Experience with big data workflow orchestrators like Argo Worklfows
  • Hands-on experience with cloud-based data stores like Redshift or BigQuery (preferred).
  • Familiarity with cloud platforms, preferably GCP or Azure .
  • Development Practices :

  • Strong programming skills in Python , with experience in frameworks like FastAPI or similar API frameworks.
  • Proficiency in unit testing and ensuring code quality.
  • Hands-on experience with version control tools like Git .
  • Optimization & Problem Solving :

  • Ability to analyze complex data pipelines, identify performance bottlenecks, and suggest optimization strategies.
  • Work collaboratively with infrastructure teams to ensure a robust and scalable platform for data science workflows.
  • Collaboration & Communication :

  • Excellent problem-solving skills and the ability to work effectively in a team environment.
  • Strong communication skills to collaborate across teams and share technical insights.
  • Nice To Have :

  • Experience with microservices architecture, containerization using Docker , and orchestration tools like Kubernetes .
  • Exposure to MLOps practices or machine learning workflows using Spark.
  • Understanding of logging, monitoring, and alerting for production-grade big data pipelines.
  • This role is ideal for someone eager to grow their expertise in modern data engineering practices while contributing to impactful projects in a collaborative environment.

    Create a job alert for this search

    Lead Data Engineer • Haryāna, Republic Of India, IN

    Related jobs
    Data Engineer

    Data Engineer

    EXL • haryana, haryana, in
    Design and develop ETL / ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake. Write efficient and optimized ...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer

    Data Engineer

    Azilen Technologies • Haryāna, Republic Of India, IN
    Manage and create design schema, SQL query tuning, and code review.Min 4+ years of professional experience in the field of data engineering with knowledge of the data platform and DWH development.D...Show more
    Last updated: 13 days ago • Promoted
    Principal Data Integration Engineer

    Principal Data Integration Engineer

    EXL • Haryāna, Republic Of India, IN
    Design, develop, test, and deploy data integration processes (batch or real-time) using tools such as Microsoft SSIS, Azure Data Factory, Databricks, Matillion, Airflow, Sqoop, etc.Create functiona...Show more
    Last updated: 20 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    KKR • Haryāna, Republic Of India, IN
    KKR aims to generate attractive investment returns by following a patient and disciplined investment approach, employing world-class people, and supporting growth in its portfolio companies and com...Show more
    Last updated: 13 days ago • Promoted
    Lead Data Pipeline Architect

    Lead Data Pipeline Architect

    EXL • Haryāna, Republic Of India, IN
    Design, develop, test, and deploy data integration processes (batch or real-time) using tools such as Microsoft SSIS, Azure Data Factory, Databricks, Matillion, Airflow, Sqoop, etc.Create functiona...Show more
    Last updated: 20 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Terra Technology Circle Consulting Private Limited • Haryāna, Republic Of India, IN
    We are seeking a highly skilled and motivated.In this role, you will design, build, and optimize scalable data pipelines and architectures to support analytics, machine learning, and business intel...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer

    Data Engineer

    TBO.COM • Haryāna, Republic Of India, IN
    TBO is a global platform that aims to simplify all buying and selling travel needs of travel partners across the world.The proprietary technology platform aims to simplify the demands of the comple...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer

    Data Engineer

    Movate • haryana, haryana, in
    Shift Timing – 3PM – 12AM (Work from office).Notice Period : Immediate to 15 days.Strong proficiency in SQL and Python for data transformation and automation. Hands-on experience building and support...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Pacific Data Integrators • Haryāna, Republic Of India, IN
    Shift time : Open to work in EST shift (5PM to 2AM IST).Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (ID...Show more
    Last updated: 13 days ago • Promoted
    Lead Data Architect

    Lead Data Architect

    WPP • haryana, haryana, in
    WPP OPEN is WPP's proprietary, AI-powered operating system designed to connect our people, data, and technology to deliver integrated, creative, and effective solutions for our clients.It is a stra...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Impetus • haryana, haryana, in
    GCP Developer for Gurgaon / Bangalore location.We are looking for a person with Bigdata, Spark, Pyspark, Python & with GCP combination - Bigquery, Dataproc, Pubsub, Cloud Composer, GCS or etc.If you ...Show more
    Last updated: 23 hours ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    dunnhumby • Haryāna, Republic Of India, IN
    Retail Media is transforming how advertisers connect with consumers through personalized and targeted campaigns across retailers' digital and physical touchpoints. Retail Media Measurement plays a p...Show more
    Last updated: 9 days ago • Promoted
    Data Engineer

    Data Engineer

    Amway • Haryāna, Republic Of India, IN
    The Data Platform team is responsible for the Global Data Platform built on Google Cloud Platform (GCP) technology.This platform, called the Analytics Capability Ecosystem (ACE), is focused on prov...Show more
    Last updated: 10 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    EXL • haryana, haryana, in
    Design, develop, test, and deploy data integration processes (batch or real-time) using tools such as Microsoft SSIS, Azure Data Factory, Databricks, Matillion, Airflow, Sqoop, etc.Create functiona...Show more
    Last updated: 19 hours ago • Promoted • New!
    Data Analytics Practice Lead

    Data Analytics Practice Lead

    Eucloid Data Solutions • Haryāna, Republic Of India, IN
    The candidate will advise clients on multiple business problems and help them achieve desirable business outcomes through projects. The candidate is expected to be a highly motivated individual with...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    IGT Solutions • Haryāna, Republic Of India, IN
    We are seeking a highly skilled.Databricks, PySpark, ETL development, and SQL.The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and analytics...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer

    Data Engineer

    GMG • Haryāna, Republic Of India, IN
    GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors.Its vision is to inspir...Show more
    Last updated: 13 days ago • Promoted
    AI Data Engineer

    AI Data Engineer

    Turing • haryana, haryana, in
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 1 day ago • Promoted