Lead GCP Data Engineer

Job Description – Lead GCP Data Engineer (Python + GCP)

We are looking for an experienced Senior Data Engineer with strong skills in Python and Google Cloud Platform (GCP). You will design and maintain scalable ETL pipelines, work with key GCP services, and ensure high-quality, reliable data delivery for analytics and business needs.

Key Responsibilities

• Build and maintain ETL data pipelines using Python.
• Work with GCP services such as :
• Dataflow (batch & streaming data processing)
• BigQuery (data warehouse & analytics)
• Cloud Functions, Cloud Run (serverless compute)
• Cloud Composer / Airflow (workflow orchestration)
• GCS (cloud storage)
• IAM (access & security)
• Develop data ingestion, transformation, and cleaning logic.
• Implement data quality checks and monitoring.
• Work with APIs using FastAPI, streaming tools like Kafka, and processing engines like Spark.
• Use storage systems such as MongoDB, Redis, or Bigtable.
• Write complex SQL queries (SQL Server, Oracle, PostgreSQL).
• Participate in GitHub version control and CI / CD deployments.
• Document pipeline designs and support procedures.
• Collaborate with data science, analytics, and engineering teams.

Required Skills

Nice-to-Have Skills

Soft Skills