Talent.com
GCP Data Pipeline Engineer
GCP Data Pipeline EngineerZilo AI • Bengaluru, Republic Of India, IN
GCP Data Pipeline Engineer

GCP Data Pipeline Engineer

Zilo AI • Bengaluru, Republic Of India, IN
11 hours ago
Job description

Company Description

Zilo AI is a prominent manpower service provider dedicated to connecting businesses with highly skilled and dependable professionals across various industries. With a deep understanding that talent drives success, Zilo AI is committed to supplying the right expertise to support business growth. Our focus on talent optimization ensures that clients receive tailored solutions to meet their business needs. Joining Zilo AI provides an opportunity to work within a forward-thinking organization that values innovation and excellence.

We Are Hiring : Data Engineer (Google Cloud Platform)

Location : Tier 1 Cities-On-site ( Mumbai, Delhi, Bengaluru, Chennai, Hyderabad, Kolkata, Pune and Ahmedabad)

Are you a Data Engineer with strong hands-on experience in Google Cloud Platform (GCP) and large-scale distributed data pipelines?

We are looking for a highly skilled professional who can design, build, and maintain production-grade data systems using Spark, PySpark, BigQuery, GCS, and modern orchestration tools.

If you thrive in complex data environments and enjoy optimizing large-scale pipelines, this is the role for you.

Role : Data Engineer (GCP – Spark / PySpark / BigQuery)

As a Data Engineer, you will build and scale our cloud-native data ecosystem, develop robust ETL / ELT pipelines, and enable advanced analytics across the organization. You will work closely with data architects, analysts, and product teams to deliver high-impact data solutions.

Mandatory Skill Sets (Must-Have Experience)

Google Cloud Platform (GCP) Expertise

  • Hands-on experience working with Google Cloud Platform
  • Experience using GCS (Google Cloud Storage) in data pipelines
  • Experience with BigQuery for data modeling or analytics
  • Experience running data processing jobs using DataFlow or DataProc
  • Familiarity with Stackdriver / Cloud Logging for monitoring and logging
  • Holding a GCP Certification is a strong plus

Spark / PySpark & Distributed Processing

  • Strong experience writing production-grade Spark jobs using PySpark
  • Ability to optimize Spark workloads (partitioning, caching, join strategies)
  • Experience processing large datasets (100GB+ or distributed)
  • Ability to share a PySpark code sample for :
  • Ingesting CSV → cleaning fields → adding full_name column → writing Parquet output

    Data Pipeline Development

  • Proven experience building end-to-end ETL / ELT pipelines in production
  • Hands-on experience with Python for data processing
  • Experience with Airflow or Cloud Composer for orchestration
  • Ability to troubleshoot pipeline failures or data inconsistencies
  • Experience implementing security best practices in data pipelines
  • Data Modelling & Storage

  • Experience creating data models (star schema, snowflake, or custom designs)
  • Experience working with file formats such as JSON, AVRO, PARQUET
  • Ability to design scalable and efficient data models in analytical systems
  • Data Quality, Analytics & SQL

  • Experience implementing data quality checks within pipelines
  • Strong SQL capability, including writing complex analytical queries
  • Experience working with credit or financial datasets is a plus
  • Responsibilities

  • Design and develop scalable data pipelines using Spark, PySpark, and GCP
  • Build and optimize ELT workflows using BigQuery and Cloud Storage
  • Implement orchestration using Airflow / Cloud Composer
  • Ensure data reliability, quality, and security across all workflows
  • Troubleshoot performance bottlenecks and optimize distributed jobs
  • Collaborate with data architects and analysts on data modeling and analytics
  • Monitor pipeline health using Google Cloud monitoring tools
  • Preferred Qualifications

  • Degree in Computer Science, Engineering, or related field
  • Experience with streaming (Pub / Sub / Kafka)
  • Experience integrating CI / CD into data workflows
  • Knowledge of cloud cost optimization
  • What We Offer

  • Opportunity to work with a modern, cloud-native data stack
  • Exposure to scalable GCP technologies and distributed computing
  • Competitive compensation & benefits
  • Collaborative and fast-growing data team
  • How to Apply

    If you're excited to work on cutting-edge cloud data engineering challenges, we’d love to review your application. Please apply with your updated resume by filling up this short Form

    Form Link : https : / / forms.Gle / r9idZQLeuy8vwNYX6

    Create a job alert for this search

    Data Pipeline Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    Data Pipeline Engineer

    Data Pipeline Engineer

    LatentView Analytics • Bengaluru, Republic Of India, IN
    Designing and Implementing Data Pipelines : .Developing and maintaining scalable data pipelines using Databricks and related technologies like Azure Data Factory, Spark, and Python.Creating and optim...Show more
    Last updated: 11 hours ago • Promoted • New!
    Data Pipeline Engineer

    Data Pipeline Engineer

    Licious • Bangalore, Bangalore (division), India
    SDE 2 – Data Platform Engineer.We are looking for a strong and hands-on.The role requires solid technical expertise in building reliable data pipelines, working with big data technologies, and ensu...Show more
    Last updated: 23 hours ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Luxoft • Bengaluru, Karnataka, India
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Adastra • Bangalore, IN
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
    Last updated: 17 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Acme Services • Bengaluru, Karnataka, India
    Job Title : Data Engineer Experience : 5 to 7 Years Budget : 17 to 25 LPA Location : Bangalore Type : Full-Time Design and Development : Design, develop, and maintain scalable and robust dat...Show more
    Last updated: 21 hours ago • Promoted • New!
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    AppsForBharat • Bengaluru, Karnataka, India
    Role Overview We are looking for a Senior Data Engineer to lead the design and development of a next-generation data platform that powers real-time and batch applications at scale.This platform ...Show more
    Last updated: 1 day ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Emids • Bengaluru, Karnataka, India
    We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team. The ideal candidate will be responsible fo...Show more
    Last updated: 21 hours ago • Promoted • New!
    GCP Data Engineer

    GCP Data Engineer

    HCLTech • Bengaluru, Karnataka, India
    Looking for 5+ Years of experience notice period- immediate to 60 days Skill required - GCP - Data Side, Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Persistent Systems • Bengaluru, Karnataka, India
    About Position : We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data team.The ideal candidate will have deep expertise in SQL / PLSQL development , ...Show more
    Last updated: 21 hours ago • Promoted • New!
    GCP Data Engineer

    GCP Data Engineer

    PamTen Inc • Bengaluru, IN
    You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
    Last updated: 23 days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    Authify • Bengaluru, Republic Of India, IN
    Authify – Intelligence Engineering.Authify builds deep-tech intelligence systems that ingest, process, and analyze massive volumes of real-world data in real time. Our platforms power high-throughpu...Show more
    Last updated: 19 hours ago • Promoted • New!
    Data Pipeline Engineer

    Data Pipeline Engineer

    M Moser Associates • Bengaluru, Republic Of India, IN
    Mid-Level Backend Engineer (Remote).We're looking for a mid-level backend engineer to help build and maintain our building operations platform. You'll work with modern technologies to create APIs an...Show more
    Last updated: 19 hours ago • Promoted • New!
    GCP data Engineer

    GCP data Engineer

    Impetus • Bangalore Urban, Karnataka, India
    Provides technical leadership in Big Data space (Hadoop Stack like Spark, M / R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies. Must have : Operating knowledge of cloud co...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Impetus • Bengaluru, Karnataka, India
    We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions to fortune ...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Cimpress India • Bengaluru, Karnataka, India
    NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show more
    Last updated: 1 day ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Tata Consultancy Services • Bengaluru, Karnataka, India
    Experience : 5 years - 10 Years.Location : Bangalore / Hyderabad / Delhi / Chennai / Pune.Strong experience required in GCP. Must have done multiple large projects with GCP Big Query and ETL processes.Skills...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    Quess IT Staffing • Bengaluru, Karnataka, India
    We are looking for a highly skilled Senior Data Engineer with extensive experience in designing, building, and optimizing large-scale data pipelines and data lake architectures.The ideal candid...Show more
    Last updated: 1 day ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Trigent Software - Professional Services • Bengaluru, Karnataka, India
    Face-to-Face Interview for Shortlisted Candidates Only this Saturday (29th Nov 2025).Interested candidates, please share your updated CV to sharath_ss@trigent. Experience : 5 to 8 Yrs Job Des...Show more
    Last updated: 21 hours ago • Promoted • New!