We are seeking a skilled Data Engineer (AWS- Scala Mandatory) to join our dynamic team. This role involves building and maintaining robust data pipelines, designing scalable databases, and collaborating with stakeholders to deliver high-quality data solutions.
Responsibilities
- Build and maintain data pipelines using AWS Glue, Python, EMR / Spark, and Kafka / Kinesis streaming.
- Design and develop relational databases, preferably using Aurora Postgres.
- Write complex SQL queries and stored procedures.
- Troubleshoot and resolve data quality issues.
- Collaborate with stakeholders to understand data requirements and develop effective solutions.
- Document data pipelines, workflows, and procedures.
Required Skills
Strong understanding of cloud technologies (AWS preferred), including services like Aurora / RDS, Glue, Lambda, EC2, S3, EMR, Step Functions, CloudTrail, and CloudWatch.Hands-on experience building data pipelines using Glue, Python, EMR / Spark, and Kafka / Kinesis.Extensive experience in relational database design and development, especially with Aurora Postgres.Proficiency in Postgres SQL, including writing complex queries and stored procedures.Excellent analytical and problem-solving skills.