Big Data Support

Qualifications

• We are looking for skilled ETL pipeline support engineer to join DevOps team. In this role, you will be ensuring the smooth operation of PROD ETL pipelines. Also responsible for monitoring, troubleshooting existing pipelines.
• This role requires a strong understanding of SQL, Spark, and experience with AWS Glue and Redshift.
• Has basic level of understanding on Databricks and Debugs ETL running on Databricks
• Required Skills and Experience :
• Bachelor's degree in computer science, Engineering, or a related field.
• Proven experience in supporting and maintaining ETL pipelines.
• Strong proficiency in SQL and experience with relational databases (e.G., Redshift).
• Solid understanding of distributed computing concepts and experience with Apache Spark.
• Hands-on experience with AWS Glue and other AWS data services (e.G., S3, Lambda).
• Experience with data warehousing concepts and best practices.
• Excellent problem-solving, analytical skills and strong communication and collaboration skills.
• Ability to work independently and as part of a team.
• Preferred Skills and Experience :
• Experience with other ETL tools and technologies
• Experience with scripting languages (e.G., Python).
• Familiarity with Agile development methodologies.
• Experience with data visualization tools (e.G., Tableau, Power BI)

Roles & Responsibilities