Talent.com
No longer accepting applications
Lead GCP Data Engineer

Lead GCP Data Engineer

ImpetusBangalore, Bangalore (district)
8 days ago
Job description

Job Title : Lead Data Engineer – GCP (BigQuery

  • Composer
  • Python
  • PySpark)

Location : Bengaluru

Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibilities

About the Role :

You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products.

Key Responsibilities :

  • Architect and implement end-to-end data pipelines using BigQuery, PySpark / Spark, Python.
  • Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring.
  • Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning).
  • Develop and manage large-scale Spark / PySpark jobs for batch and potentially streaming data.
  • Ensure cloud-native architecture on GCP : storage (Cloud Storage), compute (Dataproc / Dataflow), orchestration (Composer), security / iam.
  • Lead and mentor a team of data engineers : code reviews, best practices, architecture decisions.
  • Required Skills & Qualifications :

  • Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities.
  • Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration.
  • Strong experience with PySpark / Spark for large-scale data processing.
  • Excellent proficiency in Python (scripting, automation, building frameworks).
  • Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation.
  • Experience designing data models, data warehouses / lakes, ingestion pipelines, transformations.
  • Experience building / operating CI / CD pipelines, version control (Git), test / monitoring practices.
  • Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders.
  • Why Join Us :

  • Lead a talented team and influence data engineering architecture & tooling.
  • Work on high-impact data platforms that enable business growth.
  • Use cutting-edge GCP services and modern data engineering practices.
  • Create a job alert for this search

    Gcp Data Engineer • Bangalore, Bangalore (district)

    Related jobs
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    JRD SystemsBengaluru, Karnataka, India
    Collaborate with data architects, analysts, and business teams to define and maintain.Roadnet) and modernized data sources. Partner with governance and infrastructure teams to establish.Automate and...Show moreLast updated: 6 days ago
    • Promoted
    GCP Data Architect

    GCP Data Architect

    Tata Consultancy Serviceshosur, tamil nadu, in
    Job Title : - GCP Data Architect.Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and co...Show moreLast updated: 22 days ago
    • Promoted
    GCP Lead Engineer

    GCP Lead Engineer

    ImpetusBangalore Urban, Karnataka, India
    IT experience range is preferred.Tech or any other Engineering degrees in related fields.The candidate should have extensive production experience (5 Years) with GCP, Other cloud experience would b...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Philodesign Technologies Inchosur, tamil nadu, in
    The ideal candidate will have strong hands-on expertise in.Azure Data Factory (ADF), Synapse, and Databricks.ETL, SQL, and data warehousing concepts. Design, develop, and implement ETL solutions usi...Show moreLast updated: 1 day ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    ImpetusBengaluru, Karnataka, India
    We are looking for an experienced.The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and analytics solutions that drive business insights.Design...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ImpetusBengaluru, Karnataka, India
    GCP Lead for Bangalore / Gurgaon location.We are looking candidate should have strong experience in Bigdata, spark, pyspark, Python, GCP-Bigquery, Airflow, Dataflow, Dataproc, Pubsub, Cloud Composer,...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Digitalzonehosur, tamil nadu, in
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 1 day ago
    • Promoted
    Lead GCP Data Engineer

    Lead GCP Data Engineer

    ImpetusBengaluru, Karnataka, India
    Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Cohosur, tamil nadu, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight Globalhosur, tamil nadu, in
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Senior GCP Data Engineer

    Senior GCP Data Engineer

    AscendionBengaluru, Karnataka, India
    Job Title : Senior GCP Data Engineer (7 - 12 Years).Locations : Bengaluru, Hyderabad, Chennai, Pune.We are looking for a talented GCP Big Query Data Engineer with strong SQL skills and basic proficie...Show moreLast updated: 22 days ago
    • Promoted
    GCP data Engineer

    GCP data Engineer

    ImpetusBangalore Urban, Karnataka, India
    Provides technical leadership in Big Data space (Hadoop Stack like Spark, M / R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies. Must have : Operating knowledge of cloud co...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Guidanz Inchosur, tamil nadu, in
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 1 day ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Greetings from TCS Human Resources Team!!!.TCS is hiring for Pune, Bangalore, Delhi NCR location.Skill : GCP Services (DataProc, Big Query, Composer) , Pyspark. Years of experience : 6 to 10 Years.Not...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    BrillioBengaluru, Karnataka, India
    Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through in...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpresshosur, tamil nadu, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mastekhosur, tamil nadu, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    AIMLEAPhosur, tamil nadu, in
    Senior Data Engineer – ETL & Pipeline Development.Remote (Work from Home) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.Pandas, Airflow, o...Show moreLast updated: 1 day ago