Senior Data Pipeline EngineerImpetus • Haryāna, Republic Of India, IN

Senior Data Pipeline Engineer

Impetus • Haryāna, Republic Of India, IN

5 days ago

Job description

Job Title : GCP Data Engineer

Location : Gurgaon

Experience : 3-8 years

About the Role :

Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.
Use Python and PySpark / Spark to transform, clean, aggregate and prepare data for analytics / ML.
Orchestrate workflows using Cloud Composer (Airflow) to schedule, monitor and operationalise jobs.
Optimize query performance, partitioning, clustering and cost in BigQuery.
Work with structured, semi-structured and unstructured data, integrating multiple data sources.
Collaborate with data scientists, analysts, business stakeholders to translate requirements into data solutions.
Implement data governance, quality checks, pipeline monitoring, version control & CI / CD practices.

Required Skills / Qualifications :

Strong hands-on experience with GCP services : BigQuery, Cloud Storage, DataProc / Dataproc, Dataflow, Pub / Sub, Cloud Composer. For example : designing pipelines, data ingestion, transformations. (Several roles explicitly list BigQuery + Composer + DataProc or Dataflow)

Proficiency in Python (scripting, ETL, automation) and PySpark (or Spark) for large-scale data processing.

Excellent SQL and BigQuery SQL skills, including query optimization, partitioning / clustering design.

Experience with workflow orchestration tools : Cloud Composer (Airflow) or equivalent scheduling tools.

Experience building and managing ELT / ETL / data-warehouse solutions at scale (data modelling, schemas, star / snowflake, analytics).

Good understanding of cloud-native architecture, cost optimisation, data security, monitoring, and possibly DevOps / CI / CD.

(Preferable) Certifications such as Google Cloud Professional Data Engineer or hands-on large-scale projects in GCP.

Create a job alert for this search

Senior Data Engineer • Haryāna, Republic Of India, IN

Related jobs

AWS Data Pipeline Engineer

Recruin • Haryāna, Republic Of India, IN

Design, develop, and maintain data pipelines using AWS services such as Glue, Lambda, Step Functions, EMR, Kinesis, and S3. Build and optimize data warehouses and data lakes on AWS (Redshift, Lake F...Show more

Last updated: 2 days ago • Promoted

Data Pipeline Engineer

Airtel Payments Bank • Haryāna, Republic Of India, IN

Airtel Payments Bank, India's first payments bank is a completely digital and paperless bank.The bank aims to take basic banking services to the doorstep of every Indian by leveraging Airtel's vast...Show more

Last updated: 5 days ago • Promoted

Lead GCP Data Engineer

Impetus • haryana, haryana, in

Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show more

Last updated: 5 days ago • Promoted

Senior Data Engineer

KOGTA FINANCIAL (INDIA) LIMITED • Haryana, India

ETL & Data Warehouse Developer.As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on...Show more

Last updated: 5 days ago • Promoted

Cloud Data Pipeline Specialist

Reqpedia • Haryāna, Republic Of India, IN

Job Title : Azure Data Engineer.Minimum 6+ years of experience in a Cloud Data Engineering role.Hands-on experience with Azure Cloud data tools (ADF, SHIR,. Logic Apps, ADLS Gen2, Blob Storage), Data...Show more

Last updated: 5 days ago • Promoted

Data Engineer I

OLX India • haryana, haryana, in

Gurugram, Haryana, OLX India – Engineering / Full-Time.We are looking for a talented Data Engineer who will play an integral role in the technical development of critical tools and business workflow...Show more

Last updated: 9 hours ago • Promoted • New!

Data Pipeline Architect

Terra Technology Circle Consulting Private Limited • Haryāna, Republic Of India, IN

We are seeking a highly skilled and motivated.In this role, you will design, build, and optimize scalable data pipelines and architectures to support analytics, machine learning, and business intel...Show more

Last updated: 5 days ago • Promoted

Data Pipeline Engineer

GMG • Haryāna, Republic Of India, IN

GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors.Its vision is to inspir...Show more

Last updated: 5 days ago • Promoted

Data Pipeline Engineer

EXL • Haryāna, Republic Of India, IN

We are looking for a Python & PySpark developer and data engineer who can design and build solutions for one of our Fortune 500 Client programs in the realm of Financial Master & Reference Data Man...Show more

Last updated: 5 days ago • Promoted

Principal Data Pipeline Engineer

Antal International • Haryāna, Republic Of India, IN

Udaipur 3 months then Gurugram, India.You’ll lead the development of high-performance data pipelines, ensure data integrity, and guide the engineering team with best practices and cutting-edge tech...Show more

Last updated: 5 days ago • Promoted

AI Data Engineer - 17852

Turing • haryana, haryana, in

We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more

Last updated: 5 days ago • Promoted

Data Pipeline Specialist

TBO.COM • Haryāna, Republic Of India, IN

TBO is a global platform that aims to simplify all buying and selling travel needs of travel partners across the world.The proprietary technology platform aims to simplify the demands of the comple...Show more

Last updated: 2 days ago • Promoted

Data Pipeline Architect

IGT Solutions • Haryāna, Republic Of India, IN

We are seeking a highly skilled.Databricks, PySpark, ETL development, and SQL.The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and analytics...Show more

Last updated: 5 days ago • Promoted

Data Pipeline Engineer

Sirius AI • Haryāna, Republic Of India, IN

Sirius AI is a US headquartered AI Consulting services and products company with operations in India.Sirius AI focuses on Financial Services enterprises and solutions / services delivered across mu...Show more

Last updated: 5 days ago • Promoted

Python (Airflow / DBT) Engineer

Luxoft • haryana, haryana, in

This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more

Last updated: 9 hours ago • Promoted • New!

Principal Data Pipeline Engineer

Pacific Data Integrators • Haryāna, Republic Of India, IN

Shift time : Open to work in EST shift (5PM to 2AM IST).Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (ID...Show more

Last updated: 5 days ago • Promoted

Senior Data Pipeline Developer

Terra Technology Circle Consulting Private Limited • Haryāna, Republic Of India, IN

We are seeking an experienced ETL Developer with strong hands on expertise in Spark,SQL,Databricks and snowflake and prior experience in pharmaceutical / life sciences domain.The ideal candidate will...Show more

Last updated: 5 days ago • Promoted

Data Pipeline Engineer

Amway • Haryāna, Republic Of India, IN

The Data Platform team is responsible for the Global Data Platform built on Google Cloud Platform (GCP) technology.This platform, called the Analytics Capability Ecosystem (ACE), is focused on prov...Show more

Last updated: 2 days ago • Promoted