Data Engineer

Job Title : Data Engineer III

Location : Delhi (Hybrid)

Department : Data Engineering

Reports To : Engineering Manager – Data Platform

About the Role

The Data Engineer III will lead the design and optimization of Baazi’s large-scale data platform. You’ll architect end-to-end data solutions, mentor junior engineers, and drive innovation across our AWS-based data ecosystem to enable faster, smarter insights across products.

Key Responsibilities

Architect, build, and optimize large-scale data pipelines and lakehouse systems using Iceberg or Hudi.

Design and implement advanced ETL / ELT frameworks in AWS (Glue, EMR, Redshift, Lambda).

Lead development of reusable, modular data pipeline components using PySpark, Python, and SQL.

Oversee orchestration workflows via Airflow and ensure reliability, scalability, and fault tolerance.

Collaborate with product, analytics, and engineering teams to define and maintain unified data models.

Conduct performance tuning, cost optimization, and security hardening of AWS data infrastructure.

Mentor Data Engineer I / II team members, review code, and enforce best practices.

Champion data quality frameworks, cataloging standards, and metadata-driven design.

Required Skills & Experience

4–8 years of experience in data engineering with at least 4+ years in PySpark.

Deep expertise in AWS ecosystem : Glue, EMR, S3, Lambda, Redshift, CloudWatch.

Proven hands-on experience with Apache Iceberg or Hudi (Iceberg preferred).

Strong programming skills in Python and PySpark.

Excellent command over SQL and performance optimization.

Experience with Airflow for complex pipeline orchestration.

Exposure to Kubernetes or containerized deployment environments (good to have).

Strong understanding of distributed systems, data modeling, and data governance.

Ability to translate business needs into scalable technical solutions.