Talent.com
EverestDX - Lead Data Engineer - ETL/Data Warehousing
EverestDX - Lead Data Engineer - ETL/Data WarehousingEverestDX • Hyderabad
EverestDX - Lead Data Engineer - ETL / Data Warehousing

EverestDX - Lead Data Engineer - ETL / Data Warehousing

EverestDX • Hyderabad
30+ days ago
Job description

Description :

We are seeking a highly skilled Lead Data Engineer to design, build, and scale robust data platforms and pipelines that empower business decisions and analytics.

This role combines deep technical expertise with strategic leadership, guiding a team of data engineers to deliver scalable, reliable, and high-performing data solutions.

The ideal candidate will have strong experience in cloud data ecosystems, data modeling, data quality frameworks, and cross-functional collaboration.

Key Responsibilities :

Data Architecture & Engineering :

  • Design and implement scalable, high-performance data pipelines for ingestion, transformation, and processing of structured and unstructured data.
  • Architect data lake, data warehouse, and real-time streaming solutions using modern cloud platforms (AWS, Azure, or GCP).
  • Develop and maintain ETL / ELT processes ensuring data accuracy, consistency, and integrity across systems.
  • Build and optimize data models (OLAP and OLTP) to support business intelligence, analytics, and reporting.
  • Evaluate and integrate new data management tools and frameworks to enhance data engineering capabilities.

Leadership & Collaboration :

  • Lead a team of data engineers mentor, review code, and enforce engineering best practices.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
  • Establish and enforce data governance, quality, and security standards in alignment with enterprise policies.
  • Partner with DevOps teams to ensure CI / CD automation, testing, and deployment of data pipelines.
  • Performance & Optimization :

  • Monitor data pipeline performance and proactively resolve bottlenecks or failures.
  • Optimize data workflows for cost efficiency, scalability, and processing speed.
  • Drive adoption of observability and monitoring frameworks (e.g., Datadog, Prometheus, or custom dashboards).
  • Required Skills & Experience :

  • 8+ years of professional experience in data engineering, with at least 23 years in a lead or senior capacity.
  • Strong proficiency in Python, SQL, and one or more data pipeline orchestration tools (Airflow, Dagster, Prefect, etc.).
  • Deep understanding of data warehousing concepts (e.g., Snowflake, Redshift, BigQuery, Synapse).
  • Experience with streaming technologies such as Kafka, Spark Streaming, or Flink.
  • Hands-on experience with cloud platforms (AWS, Azure, or GCP) particularly data services like S3, Glue, Dataflow, or Databricks.
  • Expertise in schema design, data modeling, and performance tuning.
  • Familiarity with containerization and orchestration tools (Docker, Kubernetes).
  • Strong understanding of CI / CD principles, version control (Git), and infrastructure-as-code (Terraform, CloudFormation).
  • Knowledge of data security, encryption, and compliance frameworks (GDPR, SOC 2).
  • Preferred Qualifications :

  • Experience leading large-scale data platform modernization or migration projects.
  • Exposure to machine learning pipeline orchestration and MLOps.
  • Certification in cloud data engineering (AWS Certified Data Analytics, GCP Data Engineer, etc.).
  • Familiarity with modern data stack tools (dbt, Fivetran, Looker, Power BI).
  • Strong communication skills and ability to collaborate in cross-functional agile environments
  • (ref : hirist.tech)

    Create a job alert for this search

    Lead Data Engineer • Hyderabad

    Related jobs
    Data Engineer Lead

    Data Engineer Lead

    JRD Systems • hyderabad, telangana, in
    The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica. This role will lead the design and delivery of.Databricks (PySpark, ...Show more
    Last updated: 7 days ago • Promoted
    Data Engineer

    Data Engineer

    Prudent Technologies and Consulting, Inc. • Hyderabad, India
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show more
    Last updated: 30+ days ago • Promoted
    HYPR4 - Data Lead Engineer - ETL / Data Warehousing

    HYPR4 - Data Lead Engineer - ETL / Data Warehousing

    Confidential • Hyderabad / Secunderabad, Telangana, India
    Data Infrastructure & Pipeline Development : .Design, develop, and optimize scalable, efficient, and reliable data pipelines for large-scale data processing and transformation.Manage and maintain da...Show more
    Last updated: 14 days ago • Promoted
    Lead Data Engineer - ETL / Data Warehousing

    Lead Data Engineer - ETL / Data Warehousing

    Sciens Technologies • Hyderabad
    Position : Lead Data Engineer Location : Pune, Hyderabad, Gurgaon (Hybrid) Experience : 7-10 years About Clairvoyant : Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Quadrant Technologies • Hyderabad, Republic Of India, IN
    Senior Data Engineer (10+ Years).Location : Chennai, Bengaluru, Hyderabad.Drive end-to-end cloud data migration, architecture design (Fabric, Synapse, Databricks), and solution delivery.Build and op...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer - ETL / Data Warehousing

    Data Engineer - ETL / Data Warehousing

    Hiringeye • Hyderabad
    Modern, we're looking for a driven and detail-oriented Data Engineer with a strong consulting background to join our Client Technology Team. In this role, you will serve as a subject matter exp...Show more
    Last updated: 30+ days ago • Promoted
    ETL Data Engineer

    ETL Data Engineer

    BPMLinks • Hyderabad, Telangana, India
    In the digital age, harnessing the power of data is crucial for business success.We offer a holistic approach that encompasses various aspects of data strategy, roadmap development, and data analyt...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Accordion India • Hyderabad, Telangana, India
    Accordion is a global private equity-focused financial consulting firm specializing in driving value creation through services rooted in Data & Analytics and powered by technology.Accordion works a...Show more
    Last updated: 18 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Hyderabad, Telangana, India
    GCP DATA ENGINEER - Contract (Long term) 4–5+ years of experience as a Data Engineer with hands-on support for Google Looker. Strong experience in data modeling and building data marts.Proficiency ...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Solutions Engineer

    Lead Data Solutions Engineer

    KPI Partners • Hyderabad, Republic Of India, IN
    We are seeking a highly skilled Principal Data Engineer to join our dynamic team at KPI Partners.Lead data engineering initiatives and projects from conception to delivery.Design and implement scal...Show more
    Last updated: 4 days ago • Promoted
    HYPR4 - Data Lead Engineer - ETL / Data Warehousing

    HYPR4 - Data Lead Engineer - ETL / Data Warehousing

    HYPR4 Cloud Tech • Hyderabad
    Description : 7+ Years Location : Hyderabad Job Type : Full-Time Responsibilities : ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Innova Solutions • Hyderabad, Telangana, India
    INNOVA Hiring Immediate Joiner For.AWS Data Engineer with SCD -1 / 2 ,AWS, SQL, Pyspark, Python @ Hyderabad, Chennai, Noida. JD : The role focuses on ETL development, AWS Cloud technologies (Glue, Athe...Show more
    Last updated: 21 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Saras Analytics • Hyderabad, Telangana, India
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpress • secunderabad, telangana, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show more
    Last updated: 21 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Quadrant Technologies • hyderabad, telangana, in
    Senior Data Engineer (10+ Years).Location : Chennai, Bengaluru, Hyderabad.Drive end-to-end cloud data migration, architecture design (Fabric, Synapse, Databricks), and solution delivery.Build and op...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Offshore

    Data Engineer - Offshore

    iO Associates • Secunderabad, Telangana, India
    Data Engineer Duration : 12 Months Working Pattern : 5 Working Days per Month Location : Remote Overview We are seeking an experienced Data Engineer with strong hands-on expertise in Snowflake and Py...Show more
    Last updated: 11 days ago • Promoted
    Azure-ETL Engineer

    Azure-ETL Engineer

    Coforge • secunderabad, telangana, in
    The ideal candidate will be responsible for designing, implementing, and maintaining scalable data solutions that support business intelligence and analytics needs. Design, implement, and maintain d...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Solutions Engineer

    Senior Data Solutions Engineer

    Quadrant Technologies • Hyderabad, Republic Of India, IN
    Senior Data Engineer (10+ Years).Location : Chennai, Bengaluru, Hyderabad.Drive end-to-end cloud data migration, architecture design (Fabric, Synapse, Databricks), and solution delivery.Build and op...Show more
    Last updated: 6 days ago • Promoted