About the Role
The Sr Data Engineer designs and develops data architectures in on-premise, cloud and hybrid platforms. The Sr Data Engineer collaborates with Data Engineers on analysis, architecture, design, and development of data warehouse and business analytics solutions. This role mentors other team members in their efforts to build data engineering skillsets.
What Youll Do
- Develop data engineering solutions, including data pipelines, visualization and analytical tools
- Design and develop data architectures in on-premise, cloud and hybrid platforms
- Perform data wrangling of heterogeneous data, exploration and discovery in pursuit of new business insights
- Actively contribute to the teams knowledge and drive new capabilities forward
- Mentor other team members in their efforts to build data engineering skillsets
- Assist team management in defining projects, including helping estimate, plan and scope work
- Prepare and contribute to presentations required by management
- Participate in additional projects and responsibilities as assigned
- Coordinate with Dev and Ops regarding testing practices to ensure quality thresholds are met.
- Contribute to design and code reviews.
- Perform other duties and projects as assigned by business management.
What Youll Bring
Bachelors Degree in Computer Engineering, Computer Science, or related field, or equivalent experience5+ years developing cloud solutions using data series; experience with cloud platforms (AWS, Azure, or Google Cloud)Hands-on development using and migrating data to cloud platformsExperience in SQL, NoSQL, and / or relational database design and developmentAdvanced knowledge and experience in building complex data pipelines with PythonExperience in languages such as SQL, DAX, Python, Java, Scala, and / or GoAnalytical approach to problem-solving; ability to use technology to tackle business problemsWorking knowledge of message queuing, stream processing, and scalable big data data storesMust Have Skills
Strong expertise in SQL (Oracle, MySQL) and NoSQL databases (Elastic, Key-Value, Document, Columnar, or Graph).Hands-on experience with data engineering frameworks(any one) such as Kafka, Kinesis, Flink, Airflow (or equivalents).Proficiency in ETL / ELT processesAWS cloud services.Python expertise is highly preferred. (alternative Bash / Shell scripting)