Talent.com
Lead GCP Data Engineer
Lead GCP Data EngineerImpetus • raipur, chattisgarh, in
No longer accepting applications
Lead GCP Data Engineer

Lead GCP Data Engineer

Impetus • raipur, chattisgarh, in
2 days ago
Job description

Job Title : Lead Data Engineer – GCP (BigQuery

  • Composer
  • Python
  • PySpark)

Location : Gurgaon

Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibilities

About the Role :

You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products.

Key Responsibilities :

  • Architect and implement end-to-end data pipelines using BigQuery, PySpark / Spark, Python.
  • Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring.
  • Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning).
  • Develop and manage large-scale Spark / PySpark jobs for batch and potentially streaming data.
  • Ensure cloud-native architecture on GCP : storage (Cloud Storage), compute (Dataproc / Dataflow), orchestration (Composer), security / iam.
  • Lead and mentor a team of data engineers : code reviews, best practices, architecture decisions.
  • Required Skills & Qualifications :

  • Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities.
  • Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration.
  • Strong experience with PySpark / Spark for large-scale data processing.
  • Excellent proficiency in Python (scripting, automation, building frameworks).
  • Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation.
  • Experience designing data models, data warehouses / lakes, ingestion pipelines, transformations.
  • Experience building / operating CI / CD pipelines, version control (Git), test / monitoring practices.
  • Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders.
  • Why Join Us :

  • Lead a talented team and influence data engineering architecture & tooling.
  • Work on high-impact data platforms that enable business growth.
  • Use cutting-edge GCP services and modern data engineering practices.
  • Create a job alert for this search

    Gcp Data Engineer • raipur, chattisgarh, in

    Related jobs
    Data Engineer

    Data Engineer

    Grantify • raipur, chattisgarh, in
    Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirat...Show more
    Last updated: 6 hours ago • Promoted • New!
    Gen AI Lead

    Gen AI Lead

    EXL • raipur, chattisgarh, in
    Serve as the primary point of contact for clients in Gen AI needs, including senior executives, to understand their needs and deliver tailored generative AI solutions. Lead multiple generative AI pr...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    N53 Tech • raipur, chattisgarh, in
    Our client is expanding their Data Engineering function and hiring across multiple levels (3 to 10 years).You will help build and scale their data architecture, data pipelines, data platform govern...Show more
    Last updated: 6 hours ago • Promoted • New!
    Freelance Data Engineer

    Freelance Data Engineer

    Leading MNC • raipur, chattisgarh, in
    Looking for a Freelance Data Engineer to join a team of rockstar developers.The candidate should have a minimum of 8+ yrs. If you're looking for freelance / part time opportunity (along with your day...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Analyst

    Senior Data Analyst

    Eternz • raipur, chattisgarh, in
    We're redefining how India buys jewelry.Eternz is India's #1 jewelry marketplace with 200+ premium brands - pioneering quick-commerce for jewelry with same-day and 4-hour delivery.Fresh off our Pre...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior LLM Engineer

    Senior LLM Engineer

    Infocusp Innovations • raipur, chattisgarh, in
    The Senior Agentic AI Engineer will lead the design, development, and deployment of.AI solutions within production environments, working across. AI, with a focus on delivering robust and fair agenti...Show more
    Last updated: 6 hours ago • Promoted • New!
    Sr PTC FlexPLM Developer / Lead

    Sr PTC FlexPLM Developer / Lead

    KMM Technologies, Inc. • raipur, chattisgarh, in
    Position Name : Sr PTC FlexPLM Developer / Lead.Work Hours : M-F Working Hours : 9am EST to 2pm US EST.There is an urgent resource need with PTC FlexPLM software implementation experience.Senior Develop...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Primesoft Inc • raipur, chattisgarh, in
    Primesoft Enterprise IT Services Pvt.As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learnin...Show more
    Last updated: 30+ days ago • Promoted
    Aurora PostgreSQL

    Aurora PostgreSQL

    People Prime Worldwide • raipur, chattisgarh, in
    We are seeking a Database Engineer with strong software engineering and cloud database infrastructure experience to support and evolve our. AWS based database platforms This is a contract role for a...Show more
    Last updated: 6 hours ago • Promoted • New!
    Full Stack Engineer

    Full Stack Engineer

    Insight Global • raipur, chattisgarh, in
    Duration : 6 month contract with potential to convert permanent.JS; primary codebase is frontend-heavy.Proficient with Git for source code management. Hands on experience with AWS Elastic Beans, EC2,...Show more
    Last updated: 30+ days ago • Promoted
    GCP Associate Cloud Engineer

    GCP Associate Cloud Engineer

    Allied Globetech • raipur, chattisgarh, in
    This is a full-time, on-site role located in Mumbai for a GCP Associate Cloud Engineer.The GCP Associate Cloud Engineer will be responsible for managing and implementing cloud-based solutions on Go...Show more
    Last updated: 6 hours ago • Promoted • New!
    NucleusTeq - Data Engineer - ETL / Data Warehousing

    NucleusTeq - Data Engineer - ETL / Data Warehousing

    Nucleusteq • Raipur
    Role Overview : We are looking for an Data Engineer with strong experience in data migration, validation, and transformation to support the large-scale migra...Show more
    Last updated: 4 days ago • Promoted
    Data Integration Engineer

    Data Integration Engineer

    LogFix SCM Solutions Pvt Ltd • raipur, chattisgarh, in
    We are seeking an experienced NiFi Developer with a strong background in data integration, data flow.The ideal candidate will be responsible for building, optimizing, and.Apache NiFi to ensure effi...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior SQL Developer

    Senior SQL Developer

    Programmers.io • raipur, chattisgarh, in
    Job Title : Senior SQL Developer.Shift Timings : 2 : 30 PM - 11 : 30 PM IST.Location : Remote, India, Work from Home.Experience Required : 7 - 13 Years. Design, develop, and maintain SQL Server database...Show more
    Last updated: 23 days ago • Promoted
    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    Peak Trust Global Real Estate • raipur, India
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • raipur, chattisgarh, in
    We offer a vibrant and collaborative work environment, cutting-edge tools and technologies, and ample opportunities for professional growth. Job Title : Azure Data Architect.Experience required : 15+ ...Show more
    Last updated: 17 days ago • Promoted
    Lead Analyst- Operations(Data Stewardship & MDM Ops)

    Lead Analyst- Operations(Data Stewardship & MDM Ops)

    Spectral Consultants • raipur, chattisgarh, in
    Spectral Consultants is currently hiring Senior / Lead Analyst- Data Stewardship & MDM Operations role for one of the leading US-based management consulting firm. This role focuses on end-to-end MDM o...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Confidential • Raipur, India
    INR 6000000-7000000 / year (based on experience).Full Time Permanent position(Payroll and Compliance to be managed by : Incept Labs). Note : This is a requirement for one of Uplers' client - Incept La...Show more
    Last updated: 18 days ago • Promoted