Lead GCP Data Engineer

Job Title : Lead Data Engineer – Python & GCP

Location : [Hyderabad]

Experience : 10–12 Years (STRICTLY)

Employment Type : Permanent

Notice Period : Immediate / ≤ 15 Days

About the Company

Our client is a leading technology-driven organization specializing in advanced data solutions, cloud modernization, and scalable enterprise analytics. They empower global businesses to make data-driven decisions through innovative engineering and cloud strategies, leveraging modern tools and platforms like GCP, Python, and Big Data technologies.

Job Description

We are seeking an experienced Lead Data Engineer with deep expertise in Python and Google Cloud Platform (GCP). The ideal candidate will be responsible for designing, architecting, developing, and managing robust ETL / ELT pipelines and ensuring seamless data flow across systems.

Key Responsibilities

• Design, develop, and maintain data pipelines using Python and GCP services.
• Architect enterprise-level data solutions leveraging technologies such as Kafka, GKE, APIGEE, and DBT.
• Work with GCP services including Dataflow, Cloud Functions, BigQuery, Cloud Composer, IAM, and Cloud Run.
• Implement data ingestion, transformation, and quality checks ensuring integrity and scalability.
• Collaborate with business teams, analysts, and data scientists to deliver data solutions.
• Manage deployments via GitHub CI / CD, version control, and Airflow orchestration.
• Document designs, flows, and operational procedures.

Mandatory Skills

Python (10–12 years) – Backend & Data Engineering

Google Cloud Platform (Dataflow, BigQuery, Composer, Cloud Functions)

Apache Spark, Kafka, Airflow, Redis, FastAPI

Data pipeline architecture, ETL / ELT, and data transformation

SQL (PostgreSQL, Oracle, SQL Server)

GitHub, CI / CD, and GKE / Cloud Run deployment experience

Good to Have

Experience with Snowflake or Databricks

Familiarity with Azure Data Factory (ADF)

Exposure to data migration and multi-cloud solutions

Education

Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

Important Note (Please Read Before Applying)

Do NOT apply if :

Apply ONLY if you meet all mandatory skills and experience criteria above.