AWS Engineer

Responsibilities Include

• Hands-on experience with Hadoop, Spark with Python on AWS.
• Provide technical support for data engineering systems, addressing user queries, and resolving issues related to data pipelines, AWS services, Snowflake, Hadoop, and Spark.
• Investigate and troubleshoot issues in data pipelines, identifying root causes and implementing solutions to prevent recurrence.
• Experience with a range of big data architectures like Hadoop,Spark,Kafka,Hive or other big data technologies.
• Effectively manage and resolve incidents related to data processing, ensuring minimal downtime and optimal system performance.
• Collaborate with cross-functional teams to prioritize and address critical issues promptly.
• Experience in Tuning and Optimizing Spark jobs
• Knowledge on Terraform templates for Infrastructure provisioning on AWS (or cloud formation templates)
• Possess minimum 3+ years of in BI / DW development experience with Data Model Architecture / Design.
• Should have a good understanding of functional programming concepts.
• Good knowledge of Python with experience of production grade Python projects.
• Continuous Integration, branching and merging, pair programming, code reviews, unit testing, agile methodologies (Scrum), Design Patterns.
• Knowledge on CI / CD implementation like AWS Code Commit, Code Deploy for CI / CD pipelines (Git knowledge preferable)
• Knowledge on Scheduling Tools and techniques on Hadoop / EMR.
• Excellent written and verbal communication skills.
• Strong analytical and project management skills.

Technical Essentials

Skills Required

Nosql, snowflake , Py Spark, Databricks, LAMDA, Sql, Python, Aws, Hadoop