Talent.com
Lead Gcp Data Engineer
Lead Gcp Data EngineerImpetus • Haryāna, Republic Of India, IN
Lead Gcp Data Engineer

Lead Gcp Data Engineer

Impetus • Haryāna, Republic Of India, IN
1 day ago
Job description

Job Title : Lead Data Engineer – GCP (BigQuery

  • Composer
  • Python
  • PySpark)

Location : Gurgaon

Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibilities

About the Role :

You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products.

Key Responsibilities :

  • Architect and implement end-to-end data pipelines using BigQuery, PySpark / Spark, Python.
  • Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring.
  • Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning).
  • Develop and manage large-scale Spark / PySpark jobs for batch and potentially streaming data.
  • Ensure cloud-native architecture on GCP : storage (Cloud Storage), compute (Dataproc / Dataflow), orchestration (Composer), security / iam.
  • Lead and mentor a team of data engineers : code reviews, best practices, architecture decisions.
  • Required Skills & Qualifications :

  • Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities.
  • Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration.
  • Strong experience with PySpark / Spark for large-scale data processing.
  • Excellent proficiency in Python (scripting, automation, building frameworks).
  • Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation.
  • Experience designing data models, data warehouses / lakes, ingestion pipelines, transformations.
  • Experience building / operating CI / CD pipelines, version control (Git), test / monitoring practices.
  • Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders.
  • Why Join Us :

  • Lead a talented team and influence data engineering architecture & tooling.
  • Work on high-impact data platforms that enable business growth.
  • Use cutting-edge GCP services and modern data engineering practices.
  • Create a job alert for this search

    Gcp Data Engineer • Haryāna, Republic Of India, IN

    Related jobs
    Lead Engineer Data [T500-20747]

    Lead Engineer Data [T500-20747]

    REA Cyber City • haryana, haryana, in
    In 1995, in a garage in Melbourne, Australia, REA Group was born from a simple question : “Can we change the way the world experiences property?”. Fast forward 30 years, REA Group is a market leader ...Show more
    Last updated: 1 day ago • Promoted
    Lead GCP Data Engineer

    Lead GCP Data Engineer

    Impetus • haryana, haryana, in
    Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show more
    Last updated: 1 day ago • Promoted
    Lead Engineer

    Lead Engineer

    dunnhumby • haryana, haryana, in
    Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy.We always put the Customer First. With deep heritage and expertise in retail – one of ...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    KKR • haryana, haryana, in
    KKR aims to generate attractive investment returns by following a patient and disciplined investment approach, employing world-class people, and supporting growth in its portfolio companies and com...Show more
    Last updated: 1 day ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Impetus • haryana, haryana, in
    Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.Use Python and PySpark / Spark to transform, clean, aggregate and prepare data for an...Show more
    Last updated: 1 day ago • Promoted
    GCP + Bigdata Engineer

    GCP + Bigdata Engineer

    Tata Consultancy Services • haryana, haryana, in
    TATA Consultancy Services is looking for Big Data Developer with Hands on experience with GCP.Required experience range : 6 to 8 years. Job locations : Chennai, Gurgaon.Demonstrated leadership in desi...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    KOGTA FINANCIAL (INDIA) LIMITED • haryana, haryana, in
    ETL & Data Warehouse Developer.As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on...Show more
    Last updated: 1 day ago • Promoted
    Senior Lead Engineer - Data [T500-20748]

    Senior Lead Engineer - Data [T500-20748]

    REA Cyber City • haryana, haryana, in
    In 1995 in a garage in Melbourne, Australia, REA Group was born from a simple question : Can we change the way the world experiences property?” Could we? Yes. Fast forward 30 years, REA Group is a ma...Show more
    Last updated: 1 day ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    MakeMyTrip • haryana, haryana, in
    At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    GMG • haryana, haryana, in
    GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors.Its vision is to inspir...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ManpowerGroup India • haryana, haryana, in
    ADF, ETL and SSIS, Python and SQL including data warehousing concepts and data warehousing principles.Proficiency in ETL tools and SQL for data extraction, transformation, and loading.Experience pe...Show more
    Last updated: 1 day ago • Promoted
    Lead Engineer - Cloud [T500-20236]

    Lead Engineer - Cloud [T500-20236]

    REA Cyber City • haryana, haryana, in
    In 1995, in a garage in Melbourne, Australia, REA Group was born from a simple question : “Can we change the way the world experiences property?”. Fast forward 30 years, REA Group is a market leader ...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    IGT Solutions • haryana, haryana, in
    We are seeking a highly skilled.Databricks, PySpark, ETL development, and SQL.The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and analytics...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    GSPANN Technologies, Inc • haryana, haryana, in
    Headquartered in California, U.GSPANN provides consulting and IT services to global clients.We help clients transform how they deliver business value by helping them optimize their IT capabilities,...Show more
    Last updated: 1 day ago • Promoted
    Senior Lead Engineer - Data [T500-20749]

    Senior Lead Engineer - Data [T500-20749]

    REA Cyber City • haryana, haryana, in
    In 1995 in a garage in Melbourne, Australia, REA Group was born from a simple question : "Can we change the way the world experiences property?” Could we? Yes. Fast forward 30 years, REA Group is a m...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Pacific Data Integrators • haryana, haryana, in
    Shift time : Open to work in EST shift (5PM to 2AM IST).Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (ID...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Terra Technology Circle Consulting Private Limited • haryana, haryana, in
    We are seeking a highly skilled and motivated.In this role, you will design, build, and optimize scalable data pipelines and architectures to support analytics, machine learning, and business intel...Show more
    Last updated: 1 day ago • Promoted
    Gcp Data Engineer

    Gcp Data Engineer

    Impetus • Haryāna, Republic Of India, IN
    Job Descriptions for Big data or Cloud Engineer.We are looking for candidates with hands on experience in pyspark with GCP cloud. IT experience range is preferred.Able to effectively use GCP managed...Show more
    Last updated: 30+ days ago • Promoted