Talent.com
GCP Data Pipeline Engineer
GCP Data Pipeline EngineerZilo AI • Bengaluru, Republic Of India, IN
GCP Data Pipeline Engineer

GCP Data Pipeline Engineer

Zilo AI • Bengaluru, Republic Of India, IN
12 hours ago
Job description

Company Description

Zilo AI is a prominent manpower service provider dedicated to connecting businesses with highly skilled and dependable professionals across various industries. With a deep understanding that talent drives success, Zilo AI is committed to supplying the right expertise to support business growth. Our focus on talent optimization ensures that clients receive tailored solutions to meet their business needs. Joining Zilo AI provides an opportunity to work within a forward-thinking organization that values innovation and excellence.

We Are Hiring : Data Engineer (Google Cloud Platform)

Location : Tier 1 Cities-On-site ( Mumbai, Delhi, Bengaluru, Chennai, Hyderabad, Kolkata, Pune and Ahmedabad)

Are you a Data Engineer with strong hands-on experience in Google Cloud Platform (GCP) and large-scale distributed data pipelines?

We are looking for a highly skilled professional who can design, build, and maintain production-grade data systems using Spark, PySpark, BigQuery, GCS, and modern orchestration tools.

If you thrive in complex data environments and enjoy optimizing large-scale pipelines, this is the role for you.

Role : Data Engineer (GCP – Spark / PySpark / BigQuery)

As a Data Engineer, you will build and scale our cloud-native data ecosystem, develop robust ETL / ELT pipelines, and enable advanced analytics across the organization. You will work closely with data architects, analysts, and product teams to deliver high-impact data solutions.

Mandatory Skill Sets (Must-Have Experience)

Google Cloud Platform (GCP) Expertise

  • Hands-on experience working with Google Cloud Platform
  • Experience using GCS (Google Cloud Storage) in data pipelines
  • Experience with BigQuery for data modeling or analytics
  • Experience running data processing jobs using DataFlow or DataProc
  • Familiarity with Stackdriver / Cloud Logging for monitoring and logging
  • Holding a GCP Certification is a strong plus

Spark / PySpark & Distributed Processing

  • Strong experience writing production-grade Spark jobs using PySpark
  • Ability to optimize Spark workloads (partitioning, caching, join strategies)
  • Experience processing large datasets (100GB+ or distributed)
  • Ability to share a PySpark code sample for :
  • Ingesting CSV → cleaning fields → adding full_name column → writing Parquet output

    Data Pipeline Development

  • Proven experience building end-to-end ETL / ELT pipelines in production
  • Hands-on experience with Python for data processing
  • Experience with Airflow or Cloud Composer for orchestration
  • Ability to troubleshoot pipeline failures or data inconsistencies
  • Experience implementing security best practices in data pipelines
  • Data Modelling & Storage

  • Experience creating data models (star schema, snowflake, or custom designs)
  • Experience working with file formats such as JSON, AVRO, PARQUET
  • Ability to design scalable and efficient data models in analytical systems
  • Data Quality, Analytics & SQL

  • Experience implementing data quality checks within pipelines
  • Strong SQL capability, including writing complex analytical queries
  • Experience working with credit or financial datasets is a plus
  • Responsibilities

  • Design and develop scalable data pipelines using Spark, PySpark, and GCP
  • Build and optimize ELT workflows using BigQuery and Cloud Storage
  • Implement orchestration using Airflow / Cloud Composer
  • Ensure data reliability, quality, and security across all workflows
  • Troubleshoot performance bottlenecks and optimize distributed jobs
  • Collaborate with data architects and analysts on data modeling and analytics
  • Monitor pipeline health using Google Cloud monitoring tools
  • Preferred Qualifications

  • Degree in Computer Science, Engineering, or related field
  • Experience with streaming (Pub / Sub / Kafka)
  • Experience integrating CI / CD into data workflows
  • Knowledge of cloud cost optimization
  • What We Offer

  • Opportunity to work with a modern, cloud-native data stack
  • Exposure to scalable GCP technologies and distributed computing
  • Competitive compensation & benefits
  • Collaborative and fast-growing data team
  • How to Apply

    If you're excited to work on cutting-edge cloud data engineering challenges, we’d love to review your application. Please apply with your updated resume by filling up this short Form

    Form Link : https : / / forms.Gle / r9idZQLeuy8vwNYX6

    Create a job alert for this search

    Data Pipeline Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    Data Pipeline Engineer

    Data Pipeline Engineer

    LatentView Analytics • Bengaluru, Republic Of India, IN
    Designing and Implementing Data Pipelines : .Developing and maintaining scalable data pipelines using Databricks and related technologies like Azure Data Factory, Spark, and Python.Creating and optim...Show more
    Last updated: 12 hours ago • Promoted • New!
    Data Pipeline Engineer

    Data Pipeline Engineer

    Licious • Bangalore, Bangalore (division), India
    SDE 2 – Data Platform Engineer.We are looking for a strong and hands-on.The role requires solid technical expertise in building reliable data pipelines, working with big data technologies, and ensu...Show more
    Last updated: 1 day ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Adastra • Bangalore, IN
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
    Last updated: 17 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    E-Solutions • Bengaluru, Karnataka, India
    Required Technical Skill Set : GCP, PySpark, Python, HDFS, Hadoop, SQL.Good Handson Experience on GCP.Should have worked on Data Migration projects, from On-prem to Cloud. Should have Cloud Storage K...Show more
    Last updated: 8 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    HCLTech • Bengaluru, Karnataka, India
    Looking for 5+ Years of experience notice period- immediate to 60 days Skill required - GCP - Data Side, Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Emids • Bengaluru, Karnataka, India
    We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team. The ideal candidate will be responsible fo...Show more
    Last updated: 22 hours ago • Promoted • New!
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    Authify • Bengaluru, Republic Of India, IN
    Authify – Intelligence Engineering.Authify builds deep-tech intelligence systems that ingest, process, and analyze massive volumes of real-world data in real time. Our platforms power high-throughpu...Show more
    Last updated: 20 hours ago • Promoted • New!
    Data Pipeline Engineer

    Data Pipeline Engineer

    M Moser Associates • Bengaluru, Republic Of India, IN
    Mid-Level Backend Engineer (Remote).We're looking for a mid-level backend engineer to help build and maintain our building operations platform. You'll work with modern technologies to create APIs an...Show more
    Last updated: 20 hours ago • Promoted • New!
    Data Pipeline Engineer

    Data Pipeline Engineer

    Brillio • Bengaluru, Karnataka, India
    We’re Hiring : AWS Data Engineer Locations : Open (India – Bangalore, Pune, Hyderabad, Chennai, Gurgaon) Experience : 3–10 years We’re seeking talented AWS Data Engineers who are passionate ab...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    GCP data Engineer

    GCP data Engineer

    Impetus • Bangalore Urban, Karnataka, India
    Provides technical leadership in Big Data space (Hadoop Stack like Spark, M / R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies. Must have : Operating knowledge of cloud co...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Impetus • Bengaluru, Karnataka, India
    We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions to fortune ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer - GCP

    Senior Data Engineer - GCP

    AuxoAI • Bangalore Urban district, India, India
    AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP).This role is ideal f...Show more
    Last updated: 2 days ago • Promoted
    Lead GCP Data Engineer

    Lead GCP Data Engineer

    Impetus • Bengaluru, Karnataka, India
    Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    PamTen Inc • Bangalore, IN
    You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
    Last updated: 23 days ago • Promoted
    Principal Data Pipeline Engineer

    Principal Data Pipeline Engineer

    Go Digit General Insurance • Bengaluru, Karnataka, India
    Designation : Senior Data Engineer Job Location : Bangalore About Digit Insurance : Digit’s mission is to ‘Make Insurance, Simple’. We are backed by Fairfax- one of the largest global investmen...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    GCP Data Engineer

    GCP Data Engineer

    Tata Consultancy Services • Bengaluru, Karnataka, India
    Experience : 5 years - 10 Years.Location : Bangalore / Hyderabad / Delhi / Chennai / Pune.Strong experience required in GCP. Must have done multiple large projects with GCP Big Query and ETL processes.Skills...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    PwC India • Bengaluru, Karnataka, India
    Location - Pune, Bangalore, Kolkata & Gurgaon.Years of Experience - 4-8 Years.Job Accountabilities - Hands on Experience in GCP Data Components (BigQuery / Data fusion / Cloudsql etc) - Data Lake a...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    Quess IT Staffing • Bengaluru, Karnataka, India
    We are looking for a highly skilled Senior Data Engineer with extensive experience in designing, building, and optimizing large-scale data pipelines and data lake architectures.The ideal candid...Show more
    Last updated: 2 days ago • Promoted