Senior Data Pipeline EngineerImpetus • Haryāna, Republic Of India, IN
Senior Data Pipeline Engineer
Impetus • Haryāna, Republic Of India, IN
5 days ago
Job descriptionStrong hands-on experience with GCP services : BigQuery, Cloud Storage, DataProc / Dataproc, Dataflow, Pub / Sub, Cloud Composer. For example : designing pipelines, data ingestion, transformations. (Several roles explicitly list BigQuery + Composer + DataProc or Dataflow) Proficiency in Python (scripting, ETL, automation) and PySpark (or Spark) for large-scale data processing. Excellent SQL and BigQuery SQL skills, including query optimization, partitioning / clustering design. Experience with workflow orchestration tools : Cloud Composer (Airflow) or equivalent scheduling tools. Experience building and managing ELT / ETL / data-warehouse solutions at scale (data modelling, schemas, star / snowflake, analytics). Good understanding of cloud-native architecture, cost optimisation, data security, monitoring, and possibly DevOps / CI / CD. (Preferable) Certifications such as Google Cloud Professional Data Engineer or hands-on large-scale projects in GCP.
Job Title : GCP Data Engineer
Location : Gurgaon
Experience : 3-8 years
About the Role :
- Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.
- Use Python and PySpark / Spark to transform, clean, aggregate and prepare data for analytics / ML.
- Orchestrate workflows using Cloud Composer (Airflow) to schedule, monitor and operationalise jobs.
- Optimize query performance, partitioning, clustering and cost in BigQuery.
- Work with structured, semi-structured and unstructured data, integrating multiple data sources.
- Collaborate with data scientists, analysts, business stakeholders to translate requirements into data solutions.
- Implement data governance, quality checks, pipeline monitoring, version control & CI / CD practices.
Required Skills / Qualifications :
Create a job alert for this search
Senior Data Engineer • Haryāna, Republic Of India, IN
Related jobs
%20LIMITED)
AWS Data Pipeline Engineer
Recruin • Haryāna, Republic Of India, IN
Design, develop, and maintain data pipelines using AWS services such as Glue, Lambda, Step Functions, EMR, Kinesis, and S3.
Build and optimize data warehouses and data lakes on AWS (Redshift, Lake F...Show more
Last updated: 2 days ago • Promoted
Data Pipeline Engineer
Airtel Payments Bank • Haryāna, Republic Of India, IN
Airtel Payments Bank, India's first payments bank is a completely digital and paperless bank.The bank aims to take basic banking services to the doorstep of every Indian by leveraging Airtel's vast...Show more
Last updated: 5 days ago • Promoted
Lead GCP Data Engineer
Impetus • haryana, haryana, in
Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show more
Last updated: 5 days ago • Promoted
Cloud Data Pipeline Specialist
Reqpedia • Haryāna, Republic Of India, IN
Job Title : Azure Data Engineer.Minimum 6+ years of experience in a Cloud Data Engineering role.Hands-on experience with Azure Cloud data tools (ADF, SHIR,.
Logic Apps, ADLS Gen2, Blob Storage), Data...Show more
Last updated: 5 days ago • Promoted
Data Pipeline Test Engineer
Tata Consultancy Services • Haryāna, Republic Of India, IN
Required Skills and Experience : .IT experience with 3 years of ETL test experience.Strong testing background (leading, planning & execution of testing activities).
Design, develop, maintain, execute ...Show more
Last updated: 5 days ago • Promoted
Principal Data Pipeline Architect
dunnhumby • Haryāna, Republic Of India, IN
Retail Media is transforming how advertisers connect with consumers through personalized and targeted campaigns across retailers' digital and physical touchpoints.
Retail Media Measurement plays a p...Show more
Last updated: 2 days ago • Promoted
Data Pipeline Engineer
GMG • Haryāna, Republic Of India, IN
GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors.Its vision is to inspir...Show more
Last updated: 5 days ago • Promoted
Data Pipeline Engineer
EXL • Haryāna, Republic Of India, IN
We are looking for a Python & PySpark developer and data engineer who can design and build solutions for one of our Fortune 500 Client programs in the realm of Financial Master & Reference Data Man...Show more
Last updated: 5 days ago • Promoted
Principal Data Pipeline Engineer
Antal International • Haryāna, Republic Of India, IN
Udaipur 3 months then Gurugram, India.You’ll lead the development of high-performance data pipelines, ensure data integrity, and guide the engineering team with best practices and cutting-edge tech...Show more
Last updated: 5 days ago • Promoted
AI Data Engineer - 17852
Turing • haryana, haryana, in
We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models ...Show more
Last updated: 5 days ago • Promoted
Data Pipeline Specialist
TBO.COM • Haryāna, Republic Of India, IN
TBO is a global platform that aims to simplify all buying and selling travel needs of travel partners across the world.The proprietary technology platform aims to simplify the demands of the comple...Show more
Last updated: 3 days ago • Promoted
Data Pipeline Architect
IGT Solutions • Haryāna, Republic Of India, IN
We are seeking a highly skilled.Databricks, PySpark, ETL development, and SQL.The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and analytics...Show more
Last updated: 5 days ago • Promoted
Data Pipeline Architect
NAB • Haryāna, Republic Of India, IN
Proficient in executing ETL processes between data environments.Proficient at coding in SQL (additional knowledge in Python and R is highly regarded).
Proficient at creating analytics related docume...Show more
Last updated: 5 days ago • Promoted
Data Pipeline Engineer
Sirius AI • Haryāna, Republic Of India, IN
Sirius AI is a US headquartered AI Consulting services and products company with operations in India.Sirius AI focuses on Financial Services enterprises and solutions / services delivered across mu...Show more
Last updated: 5 days ago • Promoted
Senior Data Engineer
KOGTA FINANCIAL (INDIA) LIMITED • Haryāna, Republic Of India, IN
ETL & Data Warehouse Developer.As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on...Show more
Last updated: 5 days ago • Promoted
Senior Data Engineer
Pacific Data Integrators • Haryāna, Republic Of India, IN
Shift time : Open to work in EST shift (5PM to 2AM IST).Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (ID...Show more
Last updated: 5 days ago • Promoted
Principal Data Pipeline Engineer
Pacific Data Integrators • Haryāna, Republic Of India, IN
Shift time : Open to work in EST shift (5PM to 2AM IST).Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (ID...Show more
Last updated: 5 days ago • Promoted
Senior Data Pipeline Developer
Terra Technology Circle Consulting Private Limited • Haryāna, Republic Of India, IN
We are seeking an experienced ETL Developer with strong hands on expertise in Spark,SQL,Databricks and snowflake and prior experience in pharmaceutical / life sciences domain.The ideal candidate will...Show more
Last updated: 5 days ago • Promoted