Talent.com
Lead Data Engineer
Lead Data EngineerPeople Prime Worldwide • Hyderabad, Hyderabad (district)
No longer accepting applications
Lead Data Engineer

Lead Data Engineer

People Prime Worldwide • Hyderabad, Hyderabad (district)
15 days ago
Job description

Job Description :

Key Responsibilities :

  • Design, develop, test, and maintain scalable ETL data pipelines using Python.
  • Work extensively on Google Cloud Platform (GCP) services such as :

○ Dataflow for real-time and batch data processing

○ Cloud Functions for lightweight serverless compute

○ BigQuery for data warehousing and analytics

○ Cloud Composer for orchestration of data workflows (based on Apache

Airflow)

○ Google Cloud Storage (GCS) for managing data at scale

○ IAM for access control and security

○ Cloud Run for containerized application

Required Skills :

10+ years of hands-on experience in Python for backend or data engineering

projects.

  • Strong understanding and working experience with GCP cloud services
  • (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).

  • Solid understanding of data pipeline architecture, data integration, and
  • transformation techniques.

  • Experience in working with version control systems like GitHub and knowledge of
  • CI / CD practices.

  • Experience in Apache Spark, Kafka, Redis, Fast APIs, Airflow, GCP Composer DAGs.
  • Strong experience in SQL with at least one enterprise database (SQL Server,
  • Experience in data migrations from on-premise data sources to Cloud platforms.
  • Important Note (Please Read Before Applying)

    🚫 Do NOT apply if :

  • You have less than 10 years or more than 14 years of experience
  • You do not have hands-on GCP experience
  • You do not have hands-on Python experience
  • You are on a notice period longer than 15 days
  • You are looking for remote only (role is hybrid in Hyderabad)
  • You are a fresher or unrelated background (e.g., support, testing only, non-IT roles)
  • ✅ Apply ONLY if you meet ALL criteria above. Random / irrelevant applications will not be processed .

    Create a job alert for this search

    Lead Data Engineer • Hyderabad, Hyderabad (district)

    Related jobs
    Lead Data Engineer

    Lead Data Engineer

    nexocean • Hyderabad, Republic Of India, IN
    We are excited to announce an opening for Lead Data Engineer !.SQL, Python, Snowflake, ADF, ETL, Data Pipeline.Work closely with Product owners / managers to understand the business needs.Collaborate...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Prudent Technologies and Consulting, Inc. • Hyderabad, Telangana, India
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer (AWS)

    Lead Data Engineer (AWS)

    Atyeti Inc • Hyderabad, Republic Of India, IN
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.SQL and cloud-native devel...Show more
    Last updated: 25 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ValueMomentum • Hyderabad, India
    Primary skills : Databricks, PySpark, SQL.Secondary skills : Advanced SQL, Azure Data Factory, and Azure Data lake.About the Job We are seeking a Tech Lead –. Databricks Data Engineer with exper...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Straive • Hyderabad, India
    Design, build and maintain scalable batch and (optionally) streaming data pipelines using Apache Spark 3.Implement core ETL / ELT logic in Scala and Python. author efficient Spark DataFrame / Dataset j...Show more
    Last updated: 11 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Quadrant Technologies • Hyderabad, Republic Of India, IN
    Senior Data Engineer (10+ Years).Location : Chennai, Bengaluru, Hyderabad.Drive end-to-end cloud data migration, architecture design (Fabric, Synapse, Databricks), and solution delivery.Build and op...Show more
    Last updated: 10 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    S&P Global • Hyderabad, Telangana, India
    This job is with S&P Global, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.About the Rol...Show more
    Last updated: 30+ days ago • Promoted
    Lead Databricks Platform Engineer

    Lead Databricks Platform Engineer

    Sonatype • Hyderabad, Republic Of India, IN
    The Databricks Administrator will be responsible for the overall health, security, and performance of the Databricks platform. This includes managing user access, implementing and enforcing data gov...Show more
    Last updated: 7 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Accordion India • Hyderabad, Telangana, India
    Accordion is a global private equity-focused financial consulting firm specializing in driving value creation through services rooted in Data & Analytics and powered by technology.Accordion works a...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer Lead

    Data Engineer Lead

    JRD Systems • Hyderabad, Telangana, India
    The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica. This role will lead the design and delivery of.Databricks (PySpark, ...Show more
    Last updated: 10 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Adaptive Technology Insights • Hyderabad, Republic Of India, IN
    We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show more
    Last updated: 12 days ago • Promoted
    Lead Data Engineer - Azure Cloud

    Lead Data Engineer - Azure Cloud

    KPI Partners • Hyderabad, Republic Of India, IN
    KPI Partners are seeking highly skilled and experienced Senior Data Engineers who is having above 7 years to join our dynamic team at KPI, working on challenging and multi-year data transformation ...Show more
    Last updated: 3 days ago • Promoted
    Lead Data Solutions Engineer

    Lead Data Solutions Engineer

    KPI Partners • Hyderabad, Republic Of India, IN
    We are seeking a highly skilled Principal Data Engineer to join our dynamic team at KPI Partners.Lead data engineering initiatives and projects from conception to delivery.Design and implement scal...Show more
    Last updated: 7 days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Hyderabad, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 11 days ago • Promoted
    Lead Data Solutions Engineer

    Lead Data Solutions Engineer

    247Hire • Hyderabad, Republic Of India, IN
    Proven offshore recruitment solutions including candidate sourcing, screening & recruiting, sales development, VMS recruiting and more. At 247Hire, our mission is simple : to empower yours.From sourc...Show more
    Last updated: 7 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Saras Analytics • Hyderabad, Telangana, India
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show more
    Last updated: 30+ days ago • Promoted
    Lead Analytics Engineer

    Lead Analytics Engineer

    DAZN India • Hyderabad, Republic Of India, IN
    Pipeline and play a pivotal role in designing and scaling our modern data stack.This is a hands-on technical leadership role where you'll shape the data models in. Lead the development and governanc...Show more
    Last updated: 15 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Hyderabad, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted