Lead Data Engineer - SQL / Python

Description :

Key Responsibilities :

• Lead the design and implementation of modern data platforms across Azure, AWS, and Snowflake.
• Translate business requirements into robust technical solutions covering ingestion, transformation, integration, warehousing, and validation.
• Architect, build, and maintain data pipelines for analytics, reporting, and machine learning use cases.
• Develop and maintain ETL processes to move data from multiple sources into cloud data lakes and warehouses.
• Design and implement data models, lineage, and metadata management to ensure consistency and traceability.
• Optimize pipelines and workflows for performance, scalability, and cost efficiency.
• Enforce data quality, security, and governance standards across all environments.
• Support migration of legacy / on-premises ETL solutions to cloud-native platforms.
• Develop and tune SQL queries, database objects, and distributed processing workflows.
• Drive adoption of CI / CD, test automation, and DevOps practices in data engineering.
• Collaborate with architects, analysts, and data scientists to deliver end-to-end data solutions.
• Provide technical leadership, mentorship, and training to junior engineers.
• Produce and maintain comprehensive technical documentation.

Requirements & Skills :

1. Azure : Data Factory, Synapse, Databricks, Azure SQL

2. AWS : Glue, Redshift, S3, Lambda, EMR

3. Snowflake : Data warehousing, performance optimization, security features

Desired Profile :

(ref : hirist.tech)