Lead GCP Data Engineer
ImpetusBengaluru, Karnataka, India3 days ago
Job descriptionArchitect and implement end-to-end data pipelines using BigQuery, PySpark / Spark, Python. Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring. Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning). Develop and manage large-scale Spark / PySpark jobs for batch and potentially streaming data. Ensure cloud-native architecture on GCP : storage (Cloud Storage), compute (Dataproc / Dataflow), orchestration (Composer), security / iam. Lead and mentor a team of data engineers : code reviews, best practices, architecture decisions. Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities. Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration. Strong experience with PySpark / Spark for large-scale data processing. Excellent proficiency in Python (scripting, automation, building frameworks). Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation. Experience designing data models, data warehouses / lakes, ingestion pipelines, transformations. Experience building / operating CI / CD pipelines, version control (Git), test / monitoring practices. Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders. Lead a talented team and influence data engineering architecture & tooling. Work on high-impact data platforms that enable business growth. Use cutting-edge GCP services and modern data engineering practices.
Job Title : Lead Data Engineer – GCP (BigQuery
- Composer
- Python
- PySpark)
Location : Bengaluru
Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibilities
About the Role :
You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products.
Key Responsibilities :
Required Skills & Qualifications :
Why Join Us :
Create a job alert for this search
Gcp Data Engineer • Bengaluru, Karnataka, India
Related jobs
- Promoted
GCP Data Engineer
BrillioBengaluru, Karnataka, India Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through in...Show moreLast updated: 30+ days ago
- Promoted
GCP Big Data Engineer for one of the leading IT MNC
Acme ServicesBangalore, Bangalore (district) We are looking for an experienced.GCP using BigQuery, Dataflow, and Cloud Storage.Collaborate with cross-functional teams to deliver high-quality data solutions.
Ensure performance, reliability, and...Show moreLast updated: 2 days ago
- Promoted
- New!
GCP Data Engineer
JRD SystemsBengaluru, Karnataka, India Collaborate with data architects, analysts, and business teams to define and maintain.Roadnet) and modernized data sources.
Partner with governance and infrastructure teams to establish.Automate and...Show moreLast updated: 20 hours ago
- Promoted
GCP Data Architect
Tata Consultancy Serviceshosur, tamil nadu, in Job Title : - GCP Data Architect.Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and co...Show moreLast updated: 17 days ago
- Promoted
Lead Data Engineer
Tata Consultancy ServicesBengaluru, India Desired Experience Range : 10 - 17 years.Location of Requirement : Bangalore.Minimum of 8-10 years of relevant data science, Business Intelligence, or data analytics experience – preferably with a di...Show moreLast updated: 16 days ago
- Promoted
- New!
Gcp Data Engineer
JRD SystemsBengaluru, Republic Of India, IN Collaborate with data architects, analysts, and business teams to define and maintain.Roadnet) and modernized data sources.
Partner with governance and infrastructure teams to establish.Automate and...Show moreLast updated: 18 hours ago
- Promoted
GCP data Engineer
ImpetusBangalore Urban, Karnataka, India Provides technical leadership in Big Data space (Hadoop Stack like Spark, M / R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies.
Must have : Operating knowledge of cloud co...Show moreLast updated: 17 days ago
- Promoted
Lead Data Engineer - Google Cloud Platform
Live Connections Placements Private LimitedBangalore About the Role : We are looking for a Lead GCP Data Engineer with strong expertise in Google Cloud Platform, PySpark, and SQL to design, build, and manage sca...Show moreLast updated: 30+ days ago
- Promoted
GCP Data Engineer
ImpetusBengaluru, Karnataka, India We are looking for an experienced.The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and analytics solutions that drive business insights.Design...Show moreLast updated: 30+ days ago
- Promoted
Lead GCP Data Engineer
ImpetusBengaluru, Karnataka, India Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show moreLast updated: 4 days ago
- Promoted
GCP cloud engineer
ImpetusBengaluru, Karnataka, India Job Descriptions for Big data or Cloud Engineer.We are looking for candidates with hands on experience in Big Data with GCP cloud.
IT experience range is preferred.Able to effectively use GCP manage...Show moreLast updated: 30+ days ago
- Promoted
GCP Data Engineer
EXLBengaluru, IN Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 17 days ago
- Promoted
Senior GCP Data Engineer
AscendionBengaluru, Karnataka, India Job Title : Senior GCP Data Engineer (7 - 12 Years).Locations : Bengaluru, Hyderabad, Chennai, Pune.We are looking for a talented GCP Big Query Data Engineer with strong SQL skills and basic proficie...Show moreLast updated: 17 days ago
- Promoted
Senior Data Engineer
USEReadyhosur, tamil nadu, in Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 27 days ago
- Promoted
GCP Data Engineer
Tata Consultancy ServicesBengaluru, Karnataka, India TCS present an excellent opportunity for GCP Data Engineer.Job Location : Pune / Bangalore / Chennai.E1 in GCP Data Engineering.
E1 in Python; E2 in SQL; E1 in Collibra; E2 in Atacama.Experience with ...Show moreLast updated: 30+ days ago
- Promoted
GCP BigData Engineer for one of the leading Tech Giant
Acme ServicesBengaluru, Karnataka, India Position : GCP Big Data Engineer Locations : Bangalore, Pune, Mumbai, Gurgaon (Hybrid) Experience : 4–15 years Budget : ₹20–35 LPA Notice Period : Immediate to 30 days Job Description : We are look...Show moreLast updated: 16 days ago
- Promoted
GCP Devops Engineer ( Only 8-12 Years experience) only Bangalore, Kochin and chennai locations - Immediate to 15 Days notice
Tata Consultancy ServicesGreater Bengaluru Area, India We are seeking experienced GCP DevOps Engineers with strong hands-on expertise in Terraform to join our team.The ideal candidates will play a key role in a large cloud migration program, designing ...Show moreLast updated: 17 days ago
- Promoted
Data Engineer
Response Informaticshosur, tamil nadu, in AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture.
CICD - Terraform or CloudFo...Show moreLast updated: 27 days ago