We are seeking a skilled Data Engineer (AWS- Scala Mandatory) to join our dynamic team. This role involves building and maintaining robust data pipelines, designing scalable databases, and collaborating with stakeholders to deliver high-quality data solutions.
Responsibilities
- Build and maintain data pipelines using AWS Glue , Python , EMR / Spark , and Kafka / Kinesis streaming.
- Design and develop relational databases, preferably using Aurora Postgres .
- Write complex SQL queries and stored procedures .
- Troubleshoot and resolve data quality issues.
- Collaborate with stakeholders to understand data requirements and develop effective solutions.
- Document data pipelines, workflows, and procedures.
Required Skills
Strong understanding of cloud technologies (AWS preferred), including services like Aurora / RDS , Glue , Lambda , EC2 , S3 , EMR , Step Functions , CloudTrail , and CloudWatch .Hands-on experience building data pipelines using Glue , Python , EMR / Spark , and Kafka / Kinesis .Extensive experience in relational database design and development , especially with Aurora Postgres .Proficiency in Postgres SQL , including writing complex queries and stored procedures.Excellent analytical and problem-solving skills.