Lead GCP Data EngineerConfidential • Gurugram, Gurgaon / Gurugram, India
Lead GCP Data Engineer
Confidential • Gurugram, Gurgaon / Gurugram, India
26 days ago
Job descriptionArchitect and implement end-to-end data pipelines using BigQuery, PySpark / Spark, Python. Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring. Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning). Develop and manage large-scale Spark / PySpark jobs for batch and potentially streaming data. Ensure cloud-native architecture on GCP : storage (Cloud Storage), compute (Dataproc / Dataflow), orchestration (Composer), security / iam. Lead and mentor a team of data engineers : code reviews, best practices, architecture decisions. Minimum 8 years of experience in data engineering or similar, ideally with lead responsibilities. Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration. Strong experience with PySpark / Spark for large-scale data processing. Excellent proficiency in Python (scripting, automation, building frameworks). Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation. Experience designing data models, data warehouses / lakes, ingestion pipelines, transformations. Experience building / operating CI / CD pipelines, version control (Git), test / monitoring practices. Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders. Lead a talented team and influence data engineering architecture & tooling. Work on high-impact data platforms that enable business growth. Use cutting-edge GCP services and modern data engineering practices.
Job Title : Lead Data Engineer – GCP (BigQuery
- Composer
- Python
- PySpark)
Location : Gurgaon
Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibilities
About the Role :
You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products.
Key Responsibilities :
Required Skills & Qualifications :
Why Join Us :
Skills Required
Airflow, BigQuery, Git, Pyspark, Spark, Sql, Python
Create a job alert for this search
Gcp Data Engineer • Gurugram, Gurgaon / Gurugram, India
Related jobs
![Senior Lead Engineer - Data [T500-20748]](https://cdn-logos.talent.com/v1/logo/image?feedcode=clickcast-appcast-li-in-cpc&company_name=REA%20Cyber%20City)
![Lead Engineer Data [T500-20747]](https://cdn-logos.talent.com/v1/logo/image?feedcode=jobtraffic-in&company_name=REA%20Cyber%20City)
Lead Data Engineer
MakeMyTrip • Gurugram, Haryana, India
At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show more
Last updated: 4 days ago • Promoted
GCP data engineer
Confidential • Gurugram, Gurgaon / Gurugram, India
IT experience range is preferred.Able to effectively use GCP managed services e.Dataproc, Dataflow, pub / sub, Cloud functions, Big Query, GCS - At least 4 of these Services.Good to have knowledge on...Show more
Last updated: 26 days ago • Promoted
GCP + Bigdata Engineer
Tata Consultancy Services • Gurugram, Haryana, India
TATA Consultancy Services is looking for Big Data Developer with Hands on experience with GCP.Required experience range : 6 to 8 years.
Job locations : Chennai, Gurgaon.Demonstrated leadership in desi...Show more
Last updated: 4 days ago • Promoted
Lead Data Engineer
Cimpress • gurgaon, haryana, in
Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show more
Last updated: 22 days ago • Promoted
GCP Data engineer
Tata Consultancy Services • gurugram, uttar pradesh, in
Greetings from Tata Consulting Services.TCS is Hiring for GCP Data engineer.GCP Data engineer, Pyspark, Data proc, Data flow.Show more
Last updated: 17 days ago • Promoted
Tredence Analytics Solutions - Lead Data Engineer - Google Cloud Platform
Tredence Analytics Solutions Private Limited • Gurgaon
Job Description : Job Title : Lead GCP Data Engineer Skills required : GCP DE Experience, Big query, SQL, Cloud compressor / Python, Cloud functions, Datapro...Show more
Last updated: 30+ days ago • Promoted
GCP Data Engineer
PamTen Inc • gurugram, uttar pradesh, in
You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
Last updated: 14 days ago • Promoted
GCP Data Engineer
Xsell Resources • gurgaon, haryana, in
Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days.
GCP Google Cloud Professional Data Engineer Certi...Show more
Last updated: 21 days ago • Promoted
GCP data Engineer
Impetus • Gurugram, Haryana, India
Job Descriptions for Big data or Cloud Engineer.We are looking for candidates with hands on experience in pyspark with GCP cloud.
IT experience range is preferred.Able to effectively use GCP managed...Show more
Last updated: 3 days ago • Promoted
GCP Data Engineer
Confidential • Gurgaon / Gurugram, India
Hands-on experience with GCP services, specifically BigQuery, Cloud Storage, and Composer for data pipeline orchestration.
Proficiency in Databricks platform with PySpark for building and optimizing...Show more
Last updated: 30+ days ago • Promoted
Senior Lead Engineer - Data [T500-20748]
REA Cyber City • Gurugram, Haryana, India
In 1995 in a garage in Melbourne, Australia, REA Group was born from a simple question : Can we change the way the world experiences property?” Could we? Yes.
Fast forward 30 years, REA Group is a ma...Show more
Last updated: 2 days ago • Promoted
Lead Data Engineer
Saras Analytics • gurugram, uttar pradesh, in
We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value.
Our suite of work spans extraction, transformatio...Show more
Last updated: 17 days ago • Promoted
Lead Engineer Data [T500-20747]
REA Cyber City • Gurugram, Haryana, India
In 1995, in a garage in Melbourne, Australia, REA Group was born from a simple question : “Can we change the way the world experiences property?”.
Fast forward 30 years, REA Group is a market leader ...Show more
Last updated: 4 days ago • Promoted
Data Engineer (GCP)
HISH IT SERVICES • Gurgaon, Haryana, India
We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show more
Last updated: 13 days ago • Promoted
GCP Data Engineer
HCLTech • gurgaon, haryana, in
Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
Last updated: 22 days ago • Promoted
Senior Data Engineer
Talentmatics • Gurugram, Haryana, India
ETL workflows, and big data processing on Google Cloud.This role includes technical leadership, hands-on development, and driving best practices.
Design & develop ETL / ELT pipelines using.Lead data e...Show more
Last updated: 1 day ago • Promoted
Senior / Lead Data Engineer
DoublU • Gurgaon
Key Responsibilities & Technical Deliverables : 1.Data Pipeline Engineering Pipeline Development : Architect, build, and optimize complex data pi...Show more
Last updated: 27 days ago • Promoted
Gcp Data Engineer
HCLTech • Gurgaon, Republic Of India, IN
Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
Last updated: 22 days ago • Promoted