Talent.com
Lead Data Engineer
Lead Data EngineerPeople Prime Worldwide • Hyderabad, Hyderabad (district)
No longer accepting applications
Lead Data Engineer

Lead Data Engineer

People Prime Worldwide • Hyderabad, Hyderabad (district)
14 days ago
Job description

Job Description :

Key Responsibilities :

  • Design, develop, test, and maintain scalable ETL data pipelines using Python.
  • Work extensively on Google Cloud Platform (GCP) services such as :

○ Dataflow for real-time and batch data processing

○ Cloud Functions for lightweight serverless compute

○ BigQuery for data warehousing and analytics

○ Cloud Composer for orchestration of data workflows (based on Apache

Airflow)

○ Google Cloud Storage (GCS) for managing data at scale

○ IAM for access control and security

○ Cloud Run for containerized application

Required Skills :

10+ years of hands-on experience in Python for backend or data engineering

projects.

  • Strong understanding and working experience with GCP cloud services
  • (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).

  • Solid understanding of data pipeline architecture, data integration, and
  • transformation techniques.

  • Experience in working with version control systems like GitHub and knowledge of
  • CI / CD practices.

  • Experience in Apache Spark, Kafka, Redis, Fast APIs, Airflow, GCP Composer DAGs.
  • Strong experience in SQL with at least one enterprise database (SQL Server,
  • Experience in data migrations from on-premise data sources to Cloud platforms.
  • Important Note (Please Read Before Applying)

    🚫 Do NOT apply if :

  • You have less than 10 years or more than 14 years of experience
  • You do not have hands-on GCP experience
  • You do not have hands-on Python experience
  • You are on a notice period longer than 15 days
  • You are looking for remote only (role is hybrid in Hyderabad)
  • You are a fresher or unrelated background (e.g., support, testing only, non-IT roles)
  • ✅ Apply ONLY if you meet ALL criteria above. Random / irrelevant applications will not be processed .

    Create a job alert for this search

    Lead Data Engineer • Hyderabad, Hyderabad (district)

    Related jobs
    Lead Data Engineer

    Lead Data Engineer

    nexocean • Hyderabad, Republic Of India, IN
    We are excited to announce an opening for Lead Data Engineer !.SQL, Python, Snowflake, ADF, ETL, Data Pipeline.Work closely with Product owners / managers to understand the business needs.Collaborate...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer - Lead

    Data Engineer - Lead

    Confidential • Hyderabad / Secunderabad, Telangana, India
    Bachelor's degree in computer science, Engineering, or a related field.Expertise in Python and SQL for large-scale data manipulation and transformation. Extensive experience with cloud-based data pl...Show more
    Last updated: 28 days ago • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Confidential • Hyderabad / Secunderabad, Telangana, India
    The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica. This role will lead the design and delivery of.Databricks (PySpark, ...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer

    Data Engineer

    Prudent Technologies and Consulting, Inc. • Hyderabad, Telangana, India
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Quadrant Technologies • Hyderabad, Republic Of India, IN
    Senior Data Engineer (10+ Years).Location : Chennai, Bengaluru, Hyderabad.Drive end-to-end cloud data migration, architecture design (Fabric, Synapse, Databricks), and solution delivery.Build and op...Show more
    Last updated: 9 days ago • Promoted
    Tech Lead - Data Engineer

    Tech Lead - Data Engineer

    Confidential • Hyderabad / Secunderabad, Telangana, India
    Data Engineering and Analytics team.The ideal candidate will be responsible for configuring, deploying, and maintaining Quantexa software on leading cloud platforms while leveraging their expertise...Show more
    Last updated: 28 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Accordion India • Hyderabad, Telangana, India
    Accordion is a global private equity-focused financial consulting firm specializing in driving value creation through services rooted in Data & Analytics and powered by technology.Accordion works a...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer Lead

    Data Engineer Lead

    JRD Systems • Hyderabad, Telangana, India
    The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica. This role will lead the design and delivery of.Databricks (PySpark, ...Show more
    Last updated: 9 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Adaptive Technology Insights • Hyderabad, Republic Of India, IN
    We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show more
    Last updated: 11 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    S&P Global • Hyderabad, India
    Grade Level (for internal use) : .The Market Intelligence Industry Data Solutions business line provides data technology and services supporting acquisition, ingestion, content management, mastering,...Show more
    Last updated: 19 days ago • Promoted
    Lead Data Solutions Engineer

    Lead Data Solutions Engineer

    KPI Partners • Hyderabad, Republic Of India, IN
    We are seeking a highly skilled Principal Data Engineer to join our dynamic team at KPI Partners.Lead data engineering initiatives and projects from conception to delivery.Design and implement scal...Show more
    Last updated: 7 days ago • Promoted
    Technical Lead -Data Engineer

    Technical Lead -Data Engineer

    Confidential • Hyderabad / Secunderabad, Telangana
    We are seeking a highly skilled and visionary Data Engineer Technical Lead to join our growing data engineering team.This role is ideal for someone who thrives on architecting scalable data solutio...Show more
    Last updated: 24 days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Hyderabad, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 10 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Saras Analytics • Hyderabad, Telangana, India
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ValueMomentum • Hyderabad, Telangana, India
    Primary skills : Databricks, PySpark, SQL.Secondary skills : Advanced SQL, Azure Data Factory, and Azure Data Lake.About the Job We are seeking a Tech Lead –. Databricks Data Engineer with experience ...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer - Tech Lead

    Data Engineer - Tech Lead

    Confidential • Hyderabad / Secunderabad, Telangana, India
    Technical Lead (overall 9+ years good development experience) with good hands-on experience in Python / PySpark with strong experience in Spark / PySpark, Databricks, AWS services ,Spark SQL for big d...Show more
    Last updated: 28 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Confidential • Hyderabad / Secunderabad, Telangana
    Experience building and optimizing data pipelines in a distributed environment.Experience supporting and working with cross-functional teams. Proficiency working in Linux environment.Experience usin...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Hyderabad, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted