Talent.com
Lead GCP Data Engineer
Lead GCP Data EngineerImpetus • raipur, chattisgarh, in
No longer accepting applications
Lead GCP Data Engineer

Lead GCP Data Engineer

Impetus • raipur, chattisgarh, in
2 days ago
Job description

Job Title : Lead Data Engineer – GCP (BigQuery

  • Composer
  • Python
  • PySpark)

Location : Gurgaon

Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibilities

About the Role :

You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data engineers, collaborate with analytics & data science stakeholders, define best-practices, and ensure robust, production-ready pipelines that support business insights and data products.

Key Responsibilities :

  • Architect and implement end-to-end data pipelines using BigQuery, PySpark / Spark, Python.
  • Use Cloud Composer (Airflow) to orchestrate workflows, manage DAGs, scheduling, dependencies and monitoring.
  • Design and optimise BigQuery usage (partitioning, clustering, cost-control, performance tuning).
  • Develop and manage large-scale Spark / PySpark jobs for batch and potentially streaming data.
  • Ensure cloud-native architecture on GCP : storage (Cloud Storage), compute (Dataproc / Dataflow), orchestration (Composer), security / iam.
  • Lead and mentor a team of data engineers : code reviews, best practices, architecture decisions.
  • Required Skills & Qualifications :

  • Minimum ~8 years of experience in data engineering or similar, ideally with lead responsibilities.
  • Hands-on experience in GCP services—especially BigQuery (data warehousing, optimisation), Cloud Composer (Airflow) for orchestration.
  • Strong experience with PySpark / Spark for large-scale data processing.
  • Excellent proficiency in Python (scripting, automation, building frameworks).
  • Strong SQL skills (in BigQuery or similar cloud data warehouse), including complex queries, optimisation.
  • Experience designing data models, data warehouses / lakes, ingestion pipelines, transformations.
  • Experience building / operating CI / CD pipelines, version control (Git), test / monitoring practices.
  • Excellent communication and leadership skills—able to mentor, lead architecture discussions and engage stakeholders.
  • Why Join Us :

  • Lead a talented team and influence data engineering architecture & tooling.
  • Work on high-impact data platforms that enable business growth.
  • Use cutting-edge GCP services and modern data engineering practices.
  • Create a job alert for this search

    Gcp Data Engineer • raipur, chattisgarh, in

    Related jobs
    Data Engineer

    Data Engineer

    Grantify • raipur, chattisgarh, in
    Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirat...Show more
    Last updated: 14 hours ago • Promoted • New!
    Gen AI Lead

    Gen AI Lead

    EXL • raipur, chattisgarh, in
    Serve as the primary point of contact for clients in Gen AI needs, including senior executives, to understand their needs and deliver tailored generative AI solutions. Lead multiple generative AI pr...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    Leading MNC • raipur, chattisgarh, in
    Looking for a Freelance Data Engineer to join a team of rockstar developers.The candidate should have a minimum of 8+ yrs. If you're looking for freelance / part time opportunity (along with your day...Show more
    Last updated: 13 days ago • Promoted
    Lead Full-Stack + AI Engineer (Founding Team)

    Lead Full-Stack + AI Engineer (Founding Team)

    Grovio AI • raipur, chattisgarh, in
    We’re building an autonomous, multi-agent AI OS that plans, executes, and optimizes marketing across modern digital ecosystems. Think : an AI that acts like a virtual CMO — planning, writing, analyz...Show more
    Last updated: 7 hours ago • Promoted • New!
    Sr PTC FlexPLM Developer / Lead

    Sr PTC FlexPLM Developer / Lead

    KMM Technologies, Inc. • raipur, chattisgarh, in
    Position Name : Sr PTC FlexPLM Developer / Lead.Work Hours : M-F Working Hours : 9am EST to 2pm US EST.There is an urgent resource need with PTC FlexPLM software implementation experience.Senior Develop...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Primesoft Inc • raipur, chattisgarh, in
    Primesoft Enterprise IT Services Pvt.As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learnin...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Insight Global • raipur, chattisgarh, in
    Duration : 6 month contract with potential to convert permanent.JS; primary codebase is frontend-heavy.Proficient with Git for source code management. Hands on experience with AWS Elastic Beans, EC2,...Show more
    Last updated: 30+ days ago • Promoted
    NucleusTeq - Data Engineer - ETL / Data Warehousing

    NucleusTeq - Data Engineer - ETL / Data Warehousing

    Nucleusteq • Raipur
    Role Overview : We are looking for an Data Engineer with strong experience in data migration, validation, and transformation to support the large-scale migra...Show more
    Last updated: 5 days ago • Promoted
    Ai Engineer - Gpt / Langchain / Rag / Data Pipelines

    Ai Engineer - Gpt / Langchain / Rag / Data Pipelines

    Peak Trust Global Real Estate • Raipur, Republic Of India, IN
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: 10 hours ago • Promoted • New!
    Genesys Cloud Developer

    Genesys Cloud Developer

    HireAlpha • raipur, chattisgarh, in
    We are seeking a Senior Genesys Cloud Certified Developer with deep, hands-on expertise across the full range of Genesys Cloud CX capabilities. The ideal candidate will have proven experience in dep...Show more
    Last updated: 14 hours ago • Promoted • New!
    Senior SQL Developer

    Senior SQL Developer

    Programmers.io • raipur, chattisgarh, in
    Job Title : Senior SQL Developer.Shift Timings : 2 : 30 PM - 11 : 30 PM IST.Location : Remote, India, Work from Home.Experience Required : 7 - 13 Years. Design, develop, and maintain SQL Server database...Show more
    Last updated: 23 days ago • Promoted
    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    Peak Trust Global Real Estate • raipur, chattisgarh, in
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: 14 hours ago • Promoted • New!
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • raipur, chattisgarh, in
    We offer a vibrant and collaborative work environment, cutting-edge tools and technologies, and ample opportunities for professional growth. Job Title : Azure Data Architect.Experience required : 15+ ...Show more
    Last updated: 17 days ago • Promoted
    Lead Database Administrator

    Lead Database Administrator

    Lorven Technologies Inc. • raipur, chattisgarh, in
    Install, configure, patch, and upgrade Oracle databases (11g–19c).Monitor database performance and optimize queries using AWR / ADDM reports. Manage backups, recovery, and cloning with RMAN.Implement ...Show more
    Last updated: 14 hours ago • Promoted • New!
    Azure Senior Data Engineer

    Azure Senior Data Engineer

    Mastek • Raipur, Republic Of India, IN
    Greetings from TCS!!!!TCS is hiring for AWS Data EngineerExperience : 5 to 10yrsLocation : Pan IndiaMode of Driving : VirtualDate : 15-Nov-25 (Saturday)Job Description : Technical Experience 4+ years’ ...Show more
    Last updated: 2 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Confidential • Raipur, India
    INR 6000000-7000000 / year (based on experience).Full Time Permanent position(Payroll and Compliance to be managed by : Incept Labs). Note : This is a requirement for one of Uplers' client - Incept La...Show more
    Last updated: 18 days ago • Promoted
    Data Analyst / Business Analyst

    Data Analyst / Business Analyst

    ACL Digital • raipur, chattisgarh, in
    Data Analyst / Business Analyst.Strong working knowledge of healthcare domains such as.Claims, Member, Provider, and Encounter data. Strong analytical skills with the ability to interpret data, iden...Show more
    Last updated: 15 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • raipur, chattisgarh, in
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred. ML / Data Science with a focus on generative AI, LLMs, or co...Show more
    Last updated: 16 days ago • Promoted