Talent.com
Data Pipeline Engineer
Data Pipeline EngineerBaazi Games • New Delhi, Republic Of India, IN
Data Pipeline Engineer

Data Pipeline Engineer

Baazi Games • New Delhi, Republic Of India, IN
15 days ago
Job description

Job Title : Data Engineer III

Location : Delhi (Hybrid)

Department : Data Engineering

Reports To : Engineering Manager – Data Platform

About the Role

The Data Engineer III will lead the design and optimization of Baazi’s large-scale data platform. You’ll architect end-to-end data solutions, mentor junior engineers, and drive innovation across our AWS-based data ecosystem to enable faster, smarter insights across products.

Key Responsibilities

  • Architect, build, and optimize large-scale data pipelines and lakehouse systems using Iceberg or Hudi.
  • Design and implement advanced ETL / ELT frameworks in AWS (Glue, EMR, Redshift, Lambda).
  • Lead development of reusable, modular data pipeline components using PySpark, Python, and SQL.
  • Oversee orchestration workflows via Airflow and ensure reliability, scalability, and fault tolerance.
  • Collaborate with product, analytics, and engineering teams to define and maintain unified data models.
  • Conduct performance tuning, cost optimization, and security hardening of AWS data infrastructure.
  • Mentor Data Engineer I / II team members, review code, and enforce best practices.
  • Champion data quality frameworks, cataloging standards, and metadata-driven design.

Required Skills & Experience

  • 4–8 years of experience in data engineering with at least 4+ years in PySpark.
  • Deep expertise in AWS ecosystem : Glue, EMR, S3, Lambda, Redshift, CloudWatch.
  • Proven hands-on experience with Apache Iceberg or Hudi (Iceberg preferred).
  • Strong programming skills in Python and PySpark.
  • Excellent command over SQL and performance optimization.
  • Experience with Airflow for complex pipeline orchestration.
  • Exposure to Kubernetes or containerized deployment environments (good to have).
  • Strong understanding of distributed systems, data modeling, and data governance.
  • Ability to translate business needs into scalable technical solutions.
  • Create a job alert for this search

    Data Pipeline Engineer • New Delhi, Republic Of India, IN

    Related jobs
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    HNR Tech • Republic Of India, IN
    We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show more
    Last updated: 6 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Staffingine LLC • Republic Of India, IN
    The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise...Show more
    Last updated: 22 hours ago • Promoted • New!
    Data Pipeline Engineer

    Data Pipeline Engineer

    Atica Global • Pune, Republic Of India, IN
    Atica is a leading, tech-first remote sales & revenue management company for Hotels and Hotel operators in the US, enabled by a unified tech-led solution. We are a startup, funded by the top investo...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Tech Mahindra • Pune, Republic Of India, IN
    Familiarity with other ETL tools (Stitch, Talend, Informatica).REST APIs for custom connectors).Show more
    Last updated: 2 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Theron Solutions • Chennai, Republic Of India, IN
    We are seeking a highly skilled ETL Developer with 5–8 years of experience in data integration, transformation, and pipeline optimization. This role is a key part of our Data Engineering function wi...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    EXL • Chennai, Republic Of India, IN
    Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation.Lead the data validation...Show more
    Last updated: 3 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    IntraEdge • Republic Of India, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Luxoft • Chennai, Republic Of India, IN
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 2 days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Eucloid Data Solutions • Chennai, Republic Of India, IN
    Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show more
    Last updated: 21 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    UST • Pune, Republic Of India, IN
    The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and o...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    EXL • Pune, Republic Of India, IN
    DWH / ETL Developer : Strong experience in ETL development and data warehousing (SQL, Informatica).Responsibilities for Candidates. Design, develop, and maintain ETL workflows ( Informatica ).Optimize ...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Jaipur Living • Jaipur, Republic Of India, IN
    At Jaipur Living, we blend time-honored craftsmanship with modern design to create luxurious rugs and home decor.Headquartered in Acworth, Georgia, we serve global customers with a mission-driven a...Show more
    Last updated: 6 days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    MakeMyTrip • Republic Of India, IN
    At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show more
    Last updated: 24 days ago • Promoted
    Data Pipeline Engineer (GCP)

    Data Pipeline Engineer (GCP)

    Capgemini Invent • Pune, Republic Of India, IN
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more
    Last updated: 1 day ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    HCLTech • Pune, Republic Of India, IN
    We’re Expanding Our Digital & Data Talent Pool.Are you a professional ready to take on enterprise-scale transformation journey? We are on a mass hiring drive and looking for experts who can bring i...Show more
    Last updated: 6 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Yubi • Republic Of India, IN
    As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    System Soft Technologies • Republic Of India, IN
    Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
    Last updated: 3 days ago • Promoted
    Principal Data Pipeline Engineer

    Principal Data Pipeline Engineer

    EXL • Pune, Republic Of India, IN
    We are seeking a highly skilled.The ideal candidate will bring deep technical expertise, strong leadership, and the ability to collaborate effectively with global stakeholders in a fast-paced envir...Show more
    Last updated: 8 days ago • Promoted