Aws Lead Data Engineer

Job Summary : In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new Lakehouse solution. You will work across the Data Engineering organisation to design and implement scalable data infrastructure and processes using technologies such as Python, PySpark, EMR Serverless, Iceberg, Glue and Glue Data Catalog. The main goal of this position is to ensure successful migration and establish robust data quality governance across the new platform, enabling reliable and efficient data processing. Success in this role requires deep technical expertise, exceptional problem-solving skills, and the ability to lead and mentor within an agile team.

Must Have Tech Skills :

• Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering a culture of continuous learning and innovation
• Extensive experience in software architecture and solution design, including microservices, distributed systems, and cloud-native architectures.
• Expert in Python and Spark, with a deep focus on ETL data processing and data engineering practices.
• Deep technical knowledge of AWS data services and engineering practices, with demonstrable experience of implementing data pipelines using tools like EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, Athena
• Experience of delivering Lakehouse solutions / architectures

Nice To Have Tech Skills :

Key Accountabilities :

Key Skills :

Educational Background :

Bonus Skills :