Lead GCP Data Engineer

ImpetusIndia

23 hours ago

Job description

Job Title : Lead Data Engineer – GCP (BigQuery

Composer
Python
PySpark)

Location : Bengaluru

Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibilities

About the Role :

You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products.

Key Responsibilities :

Architect and implement end-to-end data pipelines using BigQuery, PySpark / Spark, Python.

Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring.

Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning).

Develop and manage large-scale Spark / PySpark jobs for batch and potentially streaming data.

Ensure cloud-native architecture on GCP : storage (Cloud Storage), compute (Dataproc / Dataflow), orchestration (Composer), security / iam.

Lead and mentor a team of data engineers : code reviews, best practices, architecture decisions.

Required Skills & Qualifications :

Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities.

Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration.

Strong experience with PySpark / Spark for large-scale data processing.

Excellent proficiency in Python (scripting, automation, building frameworks).

Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation.

Experience designing data models, data warehouses / lakes, ingestion pipelines, transformations.

Experience building / operating CI / CD pipelines, version control (Git), test / monitoring practices.

Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders.

Why Join Us :

Lead a talented team and influence data engineering architecture & tooling.

Work on high-impact data platforms that enable business growth.

Use cutting-edge GCP services and modern data engineering practices.

Create a job alert for this search

Gcp Data Engineer • India

Related jobs

Promoted

Data Engineer

Kline + CompanyNagpur, IN

Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 29 days ago

Promoted

Data Engineer

Randstad EnterpriseNagpur, IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago

Promoted

AI / ML & Data Engineer

Mindfire SolutionsNagpur, IN

We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 5 days ago

Promoted

GCP Data Engineer

EXLIndia, India

Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 13 days ago

Promoted

Senior AWS Data Engineer

CYAN360Nagpur, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Nityo InfotechNagpur, IN

Profile name- Senior Data Infrastructure Engineer - Apache Spark & Kubernetes.Minimum 5 years of experience in Data Engineering or Infrastructure roles. Proven hands-on experience with Apache Spark ...Show moreLast updated: 3 days ago

Promoted

Data Engineer

TalogyNagpur, IN

This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

IntraEdgeNagpur, IN

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

USEReadyNagpur, IN

Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

Searce IncNagpur, IN

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 24 days ago

Promoted

Senior Data Engineer

Coffeee.ioNagpur, IN

Lead Data Engineer – SnapLogic.Experience : 8+ years (with 3+ years in SnapLogic ETL).Lead Data Engineer – SnapLogic.The ideal candidate will have hands-on experience with.This role requires technic...Show moreLast updated: 3 days ago

Promoted

AWS Data Engineer

TerraGiGNagpur, IN

Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 3 days ago

Promoted

Python AWS Data Engineer

Digitrix Software LLPNagpur, IN

Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

VeraxionNagpur, IN

Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer

SAIVA AINagpur, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Data Engineer_Immediate Joiners

VXI Global SolutionsNagpur, IN

VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 13 days ago

Promoted

Senior Data Engineer

AIQUNagpur, IN

We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable. The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 3 days ago

Promoted

Freelance Data Engineer

upGradNagpur, IN

We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 12 days ago

Promoted

Data Engineer

Insight GlobalNagpur, IN

Insight Global is looking for a skilled senior level Data Engineer in Hyderabad or remote India for a large AAA gaming company on a contract for 3 months with possibility of extension or conversion...Show moreLast updated: 30+ days ago

Promoted

Senior Data Platform Engineer

Black Dog LabsNagpur, IN

Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago