Lead GCP Data Engineer
ImpetusKarnataka, India2 days ago
Job descriptionArchitect and implement end-to-end data pipelines using BigQuery, PySpark / Spark, Python. Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring. Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning). Develop and manage large-scale Spark / PySpark jobs for batch and potentially streaming data. Ensure cloud-native architecture on GCP : storage (Cloud Storage), compute (Dataproc / Dataflow), orchestration (Composer), security / iam. Lead and mentor a team of data engineers : code reviews, best practices, architecture decisions. Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities. Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration. Strong experience with PySpark / Spark for large-scale data processing. Excellent proficiency in Python (scripting, automation, building frameworks). Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation. Experience designing data models, data warehouses / lakes, ingestion pipelines, transformations. Experience building / operating CI / CD pipelines, version control (Git), test / monitoring practices. Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders. Lead a talented team and influence data engineering architecture & tooling. Work on high-impact data platforms that enable business growth. Use cutting-edge GCP services and modern data engineering practices.
Job Title : Lead Data Engineer – GCP (BigQuery
- Composer
- Python
- PySpark)
Location : Bengaluru
Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibilities
About the Role :
You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products.
Key Responsibilities :
Required Skills & Qualifications :
Why Join Us :
Create a job alert for this search
Gcp Data Engineer • Karnataka, India
Related jobs![Lead Data Engineer [T500-20510]](https://cdn-logos.talent.com/v1/logo/image?feedcode=jobscanner&company_name=ANSR)
![Data Engineer [T500-20906]](https://cdn-logos.talent.com/v1/logo/image?feedcode=jobscanner&company_name=Delta%20Air%20Lines)
- Promoted
Lead Data Engineer [T500-20510]
ANSRKarnataka, India ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show moreLast updated: 2 days ago
- Promoted
Senior GCP Data Engineer
AscendionKarnataka, India Job Title : Senior GCP Data Engineer (7 - 12 Years).Locations : Bengaluru, Hyderabad, Chennai, Pune.We are looking for a talented GCP Big Query Data Engineer with strong SQL skills and basic proficie...Show moreLast updated: 2 days ago
- Promoted
GCP Data Engineer
ImpetusKarnataka, India We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions to fortune ...Show moreLast updated: 2 days ago
- Promoted
Principal Data Engineer
AutodeskKarnataka, India We are seeking a highly experienced.Autodesk’s Analytics Data Platform (ADP).This role requires deep technical expertise in distributed data systems, large-scale pipeline orchestration, and hands-o...Show moreLast updated: 2 days ago
- Promoted
Cloud Lead (Data Science)-GCP & Martech Solutions
JellyfishKarnataka, India At Jellyfish we believe that our individual differences are our greatest assets.We are passionate about empowering every employee to reach their full potential and contribute their unique perspecti...Show moreLast updated: 2 days ago
- Promoted
GCP Data Engineer
BrillioKarnataka, India Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through in...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer
USEReadyKarnataka, India Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 2 days ago
- Promoted
GCP Big Data Engineer for one of the leading IT MNC
Acme ServicesKarnataka, India We are looking for an experienced.GCP using BigQuery, Dataflow, and Cloud Storage.Collaborate with cross-functional teams to deliver high-quality data solutions.
Ensure performance, reliability, and...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
People Tech Group IncKarnataka, India We are Hiring - Data Engineer Bengaluru!.We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects.The ideal candida...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
EVERSANAKarnataka, India At EVERSANA, we are proud to be certified as a Great Place to Work across the globe.We’re fueled by our vision to create a healthier world.
How? Our global team of more than 7,000 employees is commi...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer
Guidewire SoftwareKarnataka, India Architect, design, and develop robust, scalable, and efficient data pipelines.Design and manage platform solutions to support data engineering needs to ensure seamless integration and performance.W...Show moreLast updated: 2 days ago
- Promoted
Principal Data Engineer
PriceEasy AIKarnataka, India Join one of the most respected and cutting-edge companies in the pricing and analytics industry! PriceEasy, a VC-backed leader, empowers convenience retailers with actionable insights through advan...Show moreLast updated: 1 day ago
- Promoted
Data Engineer [T500-20906]
Delta Air LinesKarnataka, India Delta Air Lines (NYSE : DAL) is the U.Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-...Show moreLast updated: 2 days ago
- Promoted
Technical Lead-Data Engineer
Best Infosystems Ltd.Karnataka, India Technical Lead-Data Engineer_Full-Time_Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai.Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai.
Bachelor’s / relevant exp - with Snowpro Certification.Ent...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer
ValueLabsKarnataka, India With operations in over 30 countries and a client-first culture, we deliver cutting-edge digital solutions across industries.
Our teams are empowered to solve complex challenges, build secure system...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer
ZetaKarnataka, India It was founded by and Ramki Gaddipati in 2015.Our flagship processing platform - Zeta Tachyon - is the industry’s first modern, cloud-native, and fully API-enabled stack that brings together issua...Show moreLast updated: 2 days ago
- Promoted
Data Engineer [T500-19944]
Delta Air LinesKarnataka, India Delta Air Lines (NYSE : DAL) is the U.Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer
Tredence Inc.Karnataka, India Collaborate with DW / BI leads to understand new ETL pipeline development requirements.Triage issues to find gaps in existing pipelines and fix the issues.
Work with business to understand the need in...Show moreLast updated: 2 days ago