Description
We are seeking an experienced AWS Data Engineer to join our team in India. The ideal candidate will be responsible for designing and implementing data solutions on the AWS cloud platform, ensuring high performance and reliability.
Responsibilities
- Design, develop, and maintain scalable data processing systems on AWS.
- Implement data pipelines using AWS services such as Glue, Lambda, and Kinesis.
- Optimize data storage solutions and data lake architectures using S3 and Redshift.
- Collaborate with data scientists and analysts to understand data needs and deliver appropriate solutions.
- Ensure data quality and integrity by implementing appropriate validation checks and monitoring systems.
- Automate data integration processes and develop ETL workflows to streamline data operations.
Skills and Qualifications
7-10 years of experience in data engineering or related field.Strong proficiency in AWS services including S3, Redshift, Glue, Lambda, and Kinesis.Experience with SQL and NoSQL databases like PostgreSQL, DynamoDB, or similar.Proficient in programming languages such as Python, Java, or Scala.Solid understanding of data warehousing concepts and ETL processes.Experience with data modeling and data architecture design.Familiarity with data governance and data security best practices.Ability to work in an Agile environment and collaborate with cross-functional teams.Skills Required
Aws, Kafka, Etl, glue , LAMDA