Job description
- The Data Engineer will expand and optimize the data and data pipeline architecture, as well as optimize data flow and collection for cross functional teams
- The Data Engineer will perform data architecture analysis, design, development and testing to deliver data applications, services, interfaces, ETL processes, reporting and other workflow and management initiatives
- The role also will follow modern SDLC principles, test driven development and source code reviews and change control standards in order to maintain compliance with policies
- This role requires a highly motivated individual with strong technical ability, data capability, excellent communication and collaboration skills including the ability to develop and troubleshoot a diverse range of problems
- Design and develop enterprise data / data architecture solutions using Hadoop and other data technologies like Spark, Scala
Skills Required
Data Management, Sdlc, Scala, Data Architecture, Spark