Agrim - Senior Data Engineer - Python / SQL

Senior Data Engineer (SDE-3)

Location : Gurugram (Work from Office)

Experience : 5+

Tech Stack : Python, SQL (PostgreSQL / MySQL), Apache Spark, Kafka, Airflow, BigQuery / Redshift, Druid, Hadoop, Snowflake

Responsibilities :

• Design and develop scalable ETL pipelines for ingesting and transforming large datasets.
• Architect and optimize data warehouses and data lakes for high-performance analytics.
• Implement real-time and batch data processing using Apache Spark, Kafka, and Airflow.
• Work with structured and unstructured data across multiple storage solutions (Snowflake, BigQuery, Redshift, Hadoop, S3, etc.
• Ensure data quality, consistency, and integrity across multiple sources.
• Optimize SQL queries and database schemas for performance and cost efficiency.
• Implement data governance, security, and access controls.
• Collaborate with engineering, product, and analytics teams to design data models.
• Monitor and troubleshoot data pipeline failures and performance issues.
• Contribute to system design discussions, code reviews, and documentation.

Requirements :

(ref : hirist.tech)