Lead GCP Data Engineer
ImpetusDelhi, India2 days ago
Job descriptionArchitect and implement end-to-end data pipelines using BigQuery, PySpark / Spark, Python. Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring. Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning). Develop and manage large-scale Spark / PySpark jobs for batch and potentially streaming data. Ensure cloud-native architecture on GCP : storage (Cloud Storage), compute (Dataproc / Dataflow), orchestration (Composer), security / iam. Lead and mentor a team of data engineers : code reviews, best practices, architecture decisions. Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities. Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration. Strong experience with PySpark / Spark for large-scale data processing. Excellent proficiency in Python (scripting, automation, building frameworks). Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation. Experience designing data models, data warehouses / lakes, ingestion pipelines, transformations. Experience building / operating CI / CD pipelines, version control (Git), test / monitoring practices. Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders. Lead a talented team and influence data engineering architecture & tooling. Work on high-impact data platforms that enable business growth. Use cutting-edge GCP services and modern data engineering practices.
Job Title : Lead Data Engineer – GCP (BigQuery
- Composer
- Python
- PySpark)
Location : Bengaluru
Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibilities
About the Role :
You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products.
Key Responsibilities :
Required Skills & Qualifications :
Why Join Us :
Create a job alert for this search
Gcp Data Engineer • Delhi, India
Related jobs
- Promoted
Senior AWS Data Engineer
CYAN360Delhi, IN Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer GCP
EgenDelhi, India Job Overview : We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team.The ideal ...Show moreLast updated: 4 days ago
- Promoted
GCP Data Engineer
ImpetusDelhi, India About the Role : Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.
Use Python and PySpark / Spark to transform, clean, aggregate and pre...Show moreLast updated: 21 days ago
- Promoted
Senior Data Engineer
SAIVA AIDelhi, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
GCP Data Architect
Tata Consultancy Servicesdelhi, delhi, in Job Title : - GCP Data Architect.Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and co...Show moreLast updated: 15 days ago
- Promoted
GCP Data Engineer
BrillioDelhi, India Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through in...Show moreLast updated: 21 days ago
- Promoted
Freelance Data Engineer
upGradDelhi, IN We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 13 days ago
- Promoted
GCP Data Engineer
Persistent SystemsDelhi, India We are seeking the GCP Data Engineer with hands on experience in data engineering, python, jaba, etc.Role : GCP Data Engineer - Job Location : Pune - Experience : 5 to 15 Years - Job Type : Full Time E...Show moreLast updated: 11 days ago
- Promoted
GCP Data Engineer (GCP Services (DataProc, Big Query, Composer) (Scala and PySpark))
Tata Consultancy ServicesDelhi, India Greetings from TATA Consultancy Services Job Openings at TCS Skill.GCP Services (DataProc, Big Query, Composer) Good knowledge of Spark (Scala and PySpark)) Exp range : .
Pls find the Job Description ...Show moreLast updated: 15 days ago
- Promoted
GCP data Engineer
ImpetusDelhi, India Provides technical leadership in Big Data space (Hadoop Stack like Spark, M / R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies.
Responsibilities Must have : Operating know...Show moreLast updated: 15 days ago
- Promoted
GCP Data Engineer
Tata Consultancy ServicesDelhi, India, India Chennai / Hyderabd / Bangalore / Pune / Gurgoan / Noida / NCR.Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions.
Mandatory to have knowledge of Big Data A...Show moreLast updated: 15 days ago
- Promoted
GCP Data engineer
LTIMindtreeDelhi, India, India We’re Hiring : GCP Data Engineer.Interested candidates can share their CVs at : .The ideal candidate will have hands-on experience across GCP’s data ecosystem and proficiency in modern data engineerin...Show moreLast updated: 15 days ago
- Promoted
GCP Data Architect
HCLTechNoida, Uttar Pradesh, India Role : GCP Data Architect Total years of experience : 12+ Years Location : Noida, Bangalore, Chennai, Pune, Hyderabad Relevant experience for engagement : 10 Years Relevant skillset : - Maintain ar...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer_Immediate Joiners
VXI Global SolutionsMeerut, IN VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 15 days ago
- Promoted
Lead Data Engineer
Searce IncGhaziabad, IN Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 25 days ago
- Promoted
Data Engineer
VeraxionDelhi, IN Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 5 days ago
- Promoted
GCP Data Engineer
EXLMeerut, IN Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 15 days ago
- Promoted
GenAI Lead Engineer (Investment Data Platforms)
Vichara TechnologiesDelhi, India, India We are seeking a highly skilled.This role will also involve leading a cross-functional team of.Machine Learning Engineers and UI Developers.
Develop custom frameworks using.Optimize LLM usage for in...Show moreLast updated: 30+ days ago