Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.
Use Python and PySpark / Spark to transform, clean, aggregate and prepare data for analytics / ML.
Orchestrate workflows using Cloud Composer (Airflow) to schedule, monitor and operationalise jobs.
Optimize query performance, partitioning, clustering and cost in BigQuery.
Work with structured, semi-structured and unstructured data, integrating multiple data sources.
Collaborate with data scientists, analysts, business stakeholders to translate requirements into data solutions.
Implement data governance, quality checks, pipeline monitoring, version control & CI / CD practices.
Required Skills / Qualifications :
Strong hands-on experience with GCP services : BigQuery, Cloud Storage, DataProc / Dataproc, Dataflow, Pub / Sub, Cloud Composer. For example : designing pipelines, data ingestion, transformations. (Several roles explicitly list BigQuery + Composer + DataProc or Dataflow)
Proficiency in Python (scripting, ETL, automation) and PySpark (or Spark) for large-scale data processing.
Excellent SQL and BigQuery SQL skills, including query optimization, partitioning / clustering design.
Experience with workflow orchestration tools : Cloud Composer (Airflow) or equivalent scheduling tools.
Experience building and managing ELT / ETL / data-warehouse solutions at scale (data modelling, schemas, star / snowflake, analytics).
Good understanding of cloud-native architecture, cost optimisation, data security, monitoring, and possibly DevOps / CI / CD.
(Preferable) Certifications such as Google Cloud Professional Data Engineer or hands-on large-scale projects in GCP.
Create a job alert for this search
Gcp Data Engineer • Kakinada, IN
Related jobs
Data Engineer
Insight Global • Kakinada, IN
GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show more
Last updated: 30+ days ago • Promoted
GCP Platform Engineer
PamTen Inc • Kakinada, IN
The IT Cloud Platform Services teams is a dynamic mix of tech enthusiasts, problem solvers, and creative thinkers, united by our passion for leveraging cutting-edge technology to transform healthca...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Staffingine LLC • Kakinada, IN
The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions.
This role requires strong Python programming skills, expertise...Show more
Last updated: 7 hours ago • Promoted • New!
Data Engineer
IntraEdge • Kakinada, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Tata Consultancy Services • Kakinada, IN
TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
SAIVA AI • Kakinada, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
AWS Data Engineer
Vista Applied Solutions Group Inc • Kakinada, IN
Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions).
Hands-on with AWS : Glue, Lambda, Redshif...Show more
Last updated: 9 days ago • Promoted
Data Engineer
Recro • Kakinada, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Mindlance • Kakinada, IN
We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
Last updated: 7 days ago • Promoted
GCP Big Data Engineer (Full-time at a Fortune 500 tech MNC )
HARP • Kakinada, IN
We are looking for an experienced and motivated.The ideal candidate will have 5 years of relevant experience in data engineering, with a strong focus on.
This role requires strong technical expertis...Show more
Last updated: 30+ days ago • Promoted
Gcp Big Data Engineer
HARP • Kākināda, Republic Of India, IN
We are looking for an experienced and motivated.The ideal candidate will have 5 years of relevant experience in data engineering, with a strong focus on.
This role requires strong technical expertis...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Randstad Enterprise • Kakinada, IN
Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
RapidBrains • Kakinada, IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
Last updated: 14 days ago • Promoted
Data Engineer (GCP)
HISH IT SERVICES • Kakinada, IN
We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show more
Last updated: 15 days ago • Promoted
Data Engineer
Vriba Solutions • Kakinada, IN
Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions.
Data validation, quality & cleansing.Translate busin...Show more
Last updated: 30+ days ago • Promoted
Customer Engineer (Data Engineer)
Konecta • Kakinada, IN
In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
Last updated: 4 days ago • Promoted
Databricks Data Engineer Lead – Sustainability Project
Blue Cloud Softech Solutions Limited • Kakinada, IN
BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
Last updated: 9 days ago • Promoted
GCP Data Engineer
HCLTech • Kakinada, IN
Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more