Data Engineer - ETL / Python

Description :

Key Responsibilities :

• Design, develop, and maintain ETL / ELT data pipelines using PySpark, Spark, and Python
• Build and optimize data ingestion, transformation, and integration workflows on AWS
• Work extensively with AWS Glue, Athena, Redshift, and S3 for data processing
• Implement schema design, fact / dimension modelling, and data partitioning
• Write optimized SQL queries for analytics and processing at scale
• Develop and maintain data streaming pipelines using AWS Kinesis or Apache Kafka
• Conduct performance tuning and troubleshooting for data pipelines
• Ensure data quality, consistency, and high reliability throughout the pipeline lifecycle

Required Technical Skills :

Good to Have :

Preferred Qualifications :

Who Should Apply :

(ref : hirist.tech)