Talent.com
This job offer is not available in your country.
Lead Data Engineer - Python / SQL / ETL

Lead Data Engineer - Python / SQL / ETL

Zealant Consulting GroupGurugram
30+ days ago
Job description

Role Overview :

The Lead Data Engineer will define and drive the technical architecture for migrating Azure SQL databases to Google BigQuery and integrating Looker as the enterprise BI platform. This role requires leadership in data engineering best practices, pipeline optimization, governance enforcement, and mentoring the engineering team to deliver a performant, governed, and scalable data ecosystem.

Key Responsibilities :

  • Architect the end-to-end GBQ migration framework, ensuring schema optimization, data ingestion patterns, and query performance.
  • Define ELT patterns using Cloud Data Fusion, SQL, Python, and other GCP-native services.
  • Partner with CSG stakeholders to resolve complex data challenges and define scalable data models.
  • Lead code reviews, ensure implementation of IAM-based governance, logging, and monitoring.
  • Act as the technical liaison between CSG architects and StatusNeo delivery teams.
  • Align sprint deliverables with project milestones, ensuring zero slippage on critical paths.
  • Mentor Data Engineers and BI Analysts to adopt engineering and LookML best practices.

Qualifications :

  • 10+ years in Data Engineering, with at least 3+ years on GCP BigQuery.
  • Proven experience migrating large-scale databases from Azure SQL or equivalent to GBQ.
  • Strong knowledge of ELT patterns, partitioning, clustering, and optimization in GBQ.
  • Advanced SQL, Python, and Cloud Data Fusion experience.
  • Familiarity with LookML and BI integration workflows.
  • Excellent leadership, stakeholder management, and mentoring skills.
  • (ref : hirist.tech)

    Create a job alert for this search

    Lead Data Engineer • Gurugram

    Related jobs
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsDelhi, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionGhaziabad, IN
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgefaridabad, haryana, in
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Manuh Technologiesnew delhi, delhi, in
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tredence Inc.faridabad, haryana, in
    Design, build, and maintain scalable data pipelines using DBT and Airflow.Develop and optimize SQL queries and data models in Snowflake. Implement ETL / ELT workflows, ensuring data quality, performan...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivefaridabad, haryana, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIfaridabad, haryana, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesfaridabad, haryana, in
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 25 days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD Systemsfaridabad, haryana, in
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesDelhi, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubesghaziabad, uttar pradesh, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Servicesdelhi, delhi, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIDelhi, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 Companyfaridabad, haryana, in
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIDelhi, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer Team Lead

    Data Engineer Team Lead

    SGIghaziabad, uttar pradesh, in
    To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 5 days ago
    • Promoted
    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    USTfaridabad, haryana, in
    CTC, notice period, and current location details to.Apache Hadoop, Airflow, Kubernetes, and Containers.Troubleshoot Hadoop log files and work with. Required Skills & Qualifications : .Scala, Spark, Py...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Delhi, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHfaridabad, haryana, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 28 days ago
    • Promoted
    Data Analyst - Python / SQL

    Data Analyst - Python / SQL

    PLEXO HR Solutionsfaridabad, haryana, in
    Seeking experienced Data Analyst to join our analytics team! Work with cutting-edge tools and technologies.Perfect opportunity for data enthusiasts to make strategic impact through insights and ana...Show moreLast updated: 5 days ago