EY - GDS Consulting - AI And DATA - AWS - Senior

At EY, we’re all in to shape your future with confidence.

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.

Join EY and help to build a better working world.

Job Title : AWS Senior Data Engineer

Experience Required : Minimum 3-7 years

Job Summary : We are seeking a skilled Data Engineer with a strong background in data ingestion, processing, and storage. The ideal candidate will have experience working with various data sources and technologies, particularly in a cloud environment. You will be responsible for designing and implementing data pipelines, ensuring data quality, and optimizing data storage solutions.

Key Responsibilities :

• Design, develop, and maintain scalable data pipelines for data ingestion and processing using Python, Spark, and AWS services.
• Work with on-prem Oracle databases, batch files, and Confluent Kafka for data sourcing.
• Implement and manage ETL processes using AWS Glue and EMR for batch and streaming data.
• Develop and maintain data storage solutions using Medallion Architecture in S3, Redshift, and Oracle.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
• Monitor and optimize data workflows using Airflow and other orchestration tools.
• Ensure data quality and integrity throughout the data lifecycle.
• Implement CI / CD practices for data pipeline deployment using Terraform and other tools.
• Utilize monitoring and logging tools such as CloudWatch, Datadog, and Splunk to ensure system reliability and performance.
• Communicate effectively with stakeholders to gather requirements and provide updates on project status.

Technical Skills Required :

Good Additional Skills :

Communication Skills :

EY | Building a better working world

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.