Talent.com
Lead GCP Data Engineer
Lead GCP Data EngineerImpetus • raipur, chattisgarh, in
No longer accepting applications
Lead GCP Data Engineer

Lead GCP Data Engineer

Impetus • raipur, chattisgarh, in
2 days ago
Job description

Job Title : Lead Data Engineer – GCP (BigQuery

  • Composer
  • Python
  • PySpark)

Location : Gurgaon

Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibilities

About the Role :

You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products.

Key Responsibilities :

  • Architect and implement end-to-end data pipelines using BigQuery, PySpark / Spark, Python.
  • Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring.
  • Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning).
  • Develop and manage large-scale Spark / PySpark jobs for batch and potentially streaming data.
  • Ensure cloud-native architecture on GCP : storage (Cloud Storage), compute (Dataproc / Dataflow), orchestration (Composer), security / iam.
  • Lead and mentor a team of data engineers : code reviews, best practices, architecture decisions.
  • Required Skills & Qualifications :

  • Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities.
  • Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration.
  • Strong experience with PySpark / Spark for large-scale data processing.
  • Excellent proficiency in Python (scripting, automation, building frameworks).
  • Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation.
  • Experience designing data models, data warehouses / lakes, ingestion pipelines, transformations.
  • Experience building / operating CI / CD pipelines, version control (Git), test / monitoring practices.
  • Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders.
  • Why Join Us :

  • Lead a talented team and influence data engineering architecture & tooling.
  • Work on high-impact data platforms that enable business growth.
  • Use cutting-edge GCP services and modern data engineering practices.
  • Create a job alert for this search

    Gcp Data Engineer • raipur, chattisgarh, in

    Related jobs
    Data Engineer

    Data Engineer

    Grantify • raipur, chattisgarh, in
    Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirat...Show more
    Last updated: 11 hours ago • Promoted • New!
    Gen AI Lead

    Gen AI Lead

    EXL • raipur, chattisgarh, in
    Serve as the primary point of contact for clients in Gen AI needs, including senior executives, to understand their needs and deliver tailored generative AI solutions. Lead multiple generative AI pr...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    Leading MNC • raipur, chattisgarh, in
    Looking for a Freelance Data Engineer to join a team of rockstar developers.The candidate should have a minimum of 8+ yrs. If you're looking for freelance / part time opportunity (along with your day...Show more
    Last updated: 13 days ago • Promoted
    Lead Full-Stack + AI Engineer (Founding Team)

    Lead Full-Stack + AI Engineer (Founding Team)

    Grovio AI • raipur, chattisgarh, in
    We’re building an autonomous, multi-agent AI OS that plans, executes, and optimizes marketing across modern digital ecosystems. Think : an AI that acts like a virtual CMO — planning, writing, analyz...Show more
    Last updated: 4 hours ago • Promoted • New!
    Sr PTC FlexPLM Developer / Lead

    Sr PTC FlexPLM Developer / Lead

    KMM Technologies, Inc. • raipur, chattisgarh, in
    Position Name : Sr PTC FlexPLM Developer / Lead.Work Hours : M-F Working Hours : 9am EST to 2pm US EST.There is an urgent resource need with PTC FlexPLM software implementation experience.Senior Develop...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Primesoft Inc • raipur, chattisgarh, in
    Primesoft Enterprise IT Services Pvt.As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learnin...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Insight Global • raipur, chattisgarh, in
    Contract with Insight Global Client.React, React Native, TypeScript.React, React Native, and TypeScript.Deploy containerized solutions using. Ensure high-quality deliverables through.CI / CD pipelines...Show more
    Last updated: 30+ days ago • Promoted
    DLP & CASB L2 Engineer

    DLP & CASB L2 Engineer

    RENOVISION AUTOMATION SERVICES PVT.LTD • Raipur, Chhattisgarh, India
    Experience- 4+ years Job Responsibilities- Review and validate DLP and CASB alerts escalated by L1 analysts.Investigate potential data exfiltration, misuse, or policy violations across email, endp...Show more
    Last updated: 9 hours ago • Promoted • New!
    NucleusTeq - Data Engineer - ETL / Data Warehousing

    NucleusTeq - Data Engineer - ETL / Data Warehousing

    Nucleusteq • Raipur
    Role Overview : We are looking for an Data Engineer with strong experience in data migration, validation, and transformation to support the large-scale migra...Show more
    Last updated: 4 days ago • Promoted
    GCP Associate Cloud Engineer

    GCP Associate Cloud Engineer

    Allied Globetech • Raipur, Chhattisgarh, India
    Role Description This is a full-time, on-site role located in Mumbai for a GCP Associate Cloud Engineer.The GCP Associate Cloud Engineer will be responsible for managing and implementing cloud-base...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    N53 Tech • Raipur, Chhattisgarh, India
    Our client is expanding their Data Engineering function and hiring across multiple levels (3 to 10 years).You will help build and scale their data architecture, data pipelines, data platform govern...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior SQL Developer

    Senior SQL Developer

    Programmers.io • raipur, chattisgarh, in
    Job Title : Senior SQL Developer.Shift Timings : 2 : 30 PM - 11 : 30 PM IST.Location : Remote, India, Work from Home.Experience Required : 7 - 13 Years. Design, develop, and maintain SQL Server database...Show more
    Last updated: 23 days ago • Promoted
    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    Peak Trust Global Real Estate • raipur, chattisgarh, in
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: 12 hours ago • Promoted • New!
    Lead Database Administrator

    Lead Database Administrator

    Lorven Technologies Inc. • raipur, chattisgarh, in
    Install, configure, patch, and upgrade Oracle databases (11g–19c).Monitor database performance and optimize queries using AWR / ADDM reports. Manage backups, recovery, and cloning with RMAN.Implement ...Show more
    Last updated: 12 hours ago • Promoted • New!
    Data Integration Engineer

    Data Integration Engineer

    LogFix SCM Solutions Pvt Ltd • Raipur, Chhattisgarh, India
    Job Description Position : NiFi Developer Experience : 4+ Years Location : Chennai Employment Type : Full-Time Job Summary : We are seeking an experienced NiFi Developer with a strong background in dat...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Confidential • Raipur, India
    INR 6000000-7000000 / year (based on experience).Full Time Permanent position(Payroll and Compliance to be managed by : Incept Labs). Note : This is a requirement for one of Uplers' client - Incept La...Show more
    Last updated: 18 days ago • Promoted
    Data Analyst / Business Analyst

    Data Analyst / Business Analyst

    ACL Digital • raipur, chattisgarh, in
    Data Analyst / Business Analyst.Strong working knowledge of healthcare domains such as.Claims, Member, Provider, and Encounter data. Strong analytical skills with the ability to interpret data, iden...Show more
    Last updated: 15 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • raipur, chattisgarh, in
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred. ML / Data Science with a focus on generative AI, LLMs, or co...Show more
    Last updated: 16 days ago • Promoted