Talent.com
Lead Data Engineer - ETL/DataLake
Lead Data Engineer - ETL/DataLakeHackerrank • Bangalore
Lead Data Engineer - ETL / DataLake

Lead Data Engineer - ETL / DataLake

Hackerrank • Bangalore
3 days ago
Job description

About The Role :

As a Data Engineer, you'll design and scale the infrastructure that powers modern data pipelines, build scalable models, and turn massive datasets into actionable insights. Beyond coding, your work will influence product, engineering, and business decisions, helping HackerRank leverage data to accelerate innovation worldwide. You'll collaborate with a tight-knit, high-ownership team in a supportive, low-noise environment.

What You'll Do :

  • Design and maintain scalable streaming and batch data pipelines using AWS-native and open-source technologies.
  • Architect and evolve our modern data lakehouse, ensuring reliability, security, and performance.
  • Develop data models that power analytics and enable self-service reporting across teams.
  • Evaluate emerging technologies, run POCs, and implement innovative solutions for complex data challenges.
  • Partner with engineering, analytics, and product teams to deliver data systems that drive real business impact.
  • Mentor junior engineers, guiding them on best practices in data design, quality, and infrastructure.

Who You Are

  • 5+ years of experience building data engineering or BI solutions at scale.
  • Strong in data modeling and ETL pipeline design using tools like Apache Airflow or MageAI.
  • Hands-on with Spark (PySpark or Scala) and comfortable optimizing queries on Redshift, Trino, or similar.
  • Fluent in SQL and experienced with performance tuning for large datasets.
  • Skilled at solving problems of scalability, reliability, and performance across distributed systems.
  • Collaborative communicator who thrives in fast-moving, cross-functional teams.
  • Even better if you have :

  • Experience with Kafka or other real-time data streaming tools.
  • Exposure to BI platforms such as Redash, Looker, or Metabase
  • Familiarity with data governance tools like Ranger, observability tools like Grafana, or cost-optimization on AWS.
  • You will thrive in this role if :

  • You love designing systems that scale elegantly and perform flawlessly.
  • Enjoy turning complex data into clear, actionable insights.
  • Take pride in building with precision, ensuring reliability and maintainability at every layer.
  • Thrive in an environment that values ownership, curiosity, and craftsmanship over noise.
  • (ref : hirist.tech)

    Create a job alert for this search

    Lead Data Engineer • Bangalore

    Related jobs
    ETL & Tableau Data Engineer

    ETL & Tableau Data Engineer

    Magma Consultancy • Bengaluru, IN
    ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show more
    Last updated: 3 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VRIZE • Bengaluru, Karnataka, India
    Experience as a Data Engineer with strong track record of designing and implementing data solutions.Experience in programming language as Python, Pyspark with airflows. Experience with cloud data wa...Show more
    Last updated: 2 days ago • Promoted
    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    AIMLEAP • hosur, tamil nadu, in
    Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
    Last updated: 6 hours ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    MakeMyTrip • Bangalore Urban, Karnataka, India
    At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show more
    Last updated: 30+ days ago • Promoted
    ETL Developer

    ETL Developer

    TalentOnLease • hosur, tamil nadu, in
    We are looking for skilled ETL Developers with strong expertise in SQL and Informatica Intelligent Cloud Services (IICS). The role involves designing and implementing high-quality ETL workflows whil...Show more
    Last updated: 10 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    HCLTech • Greater Bengaluru Area, India
    F2F Hackathon scheduled on 22nd Nov 2025.If you are passionate about building scalable data solutions on Google Cloud and enjoy solving real-time data engineering challenges, this is the perfect op...Show more
    Last updated: 30+ days ago • Promoted
    Azure-ETL Engineer

    Azure-ETL Engineer

    Coforge • hosur, tamil nadu, in
    The ideal candidate will be responsible for designing, implementing, and maintaining scalable data solutions that support business intelligence and analytics needs. Design, implement, and maintain d...Show more
    Last updated: 30+ days ago • Promoted
    Data Bricks Engineer

    Data Bricks Engineer

    Relevance Lab • Greater Bengaluru Area, India
    SQL skills and hands-on experience using.AI-assisted development tools).The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, supporting analytics worklo...Show more
    Last updated: 1 day ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Impetus • Bengaluru, Karnataka, India
    GCP Lead for Bangalore / Gurgaon location.We are looking candidate should have strong experience in Bigdata, spark, pyspark, Python, GCP-Bigquery, Airflow, Dataflow, Dataproc, Pubsub, Cloud Composer,...Show more
    Last updated: 19 days ago • Promoted
    Data Engineer I

    Data Engineer I

    Licious • Greater Bengaluru Area, India
    SDE 1 – Data Platform Engineer.We are looking for a passionate and motivated.Software Development Engineer (SDE 1) – Data Platform. Data Platform Engineering team at.In this role, you’ll design, bui...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    VIDA Digital Identity • Greater Bengaluru Area, India
    At VIDA we’re building the future of digital identity.As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling.You’ll help us moderniz...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Veca Consulting Pvt Ltd • Bengaluru, Karnataka, India
    Role Name : Data Engineer Experience : 3+ Years Location : Bangalore(No relocation) Notice Period : 20-30 days(who are currently serving) Mode : Hybrid Type : Fulltime Job Description : As a D...Show more
    Last updated: 10 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • hosur, tamil nadu, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Tata Consultancy Services • Greater Bengaluru Area, India
    Job Title : Senior Azure Data Engineer.Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL. Good Knowledge of Data Brick lakehouse and Azure ...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer - Databricks

    Lead Data Engineer - Databricks

    Tredence Inc. • Bengaluru, Karnataka, India
    Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, Cali...Show more
    Last updated: 19 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Arcana • Greater Bengaluru Area, India
    Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamentals, a...Show more
    Last updated: 1 day ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpress • Bengaluru, Karnataka, India
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show more
    Last updated: 19 days ago • Promoted
    Data Engineer Technical Lead(Azure)

    Data Engineer Technical Lead(Azure)

    Sigmoid • Greater Bengaluru Area, India
    Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with some of the world’s leading data-rich organizations ...Show more
    Last updated: 1 day ago • Promoted