Roles and Responsibility
As a Senior Data Engineer, you will be responsible fordesigning, owning, and developing highly scalable business intelligence datamodels and services for data ingestion and data processing. This role will situniquely between Data Engineering and ML Scientists, so familiarity with ML andML dev-ops solution is a plus. This opportunity is very exciting for theversatile engineer looking to operationalize custom ML model architecture foroperational use across high-impact processes at the company.
What you’ll be doing :
- Design and implement highly scalable and secure datamodels and data marts for data ingestion, standardization, and data processing.
- In collaboration with product owners, data analysts andbusiness partners improve overall architecture, frameworks and patterns forprocessing and storing large data volumes.
- Design and implement distributed data processingpipelines using tools and languages prevalent in the data warehousingecosystem.
- Designs data validation and audit processes for qualitycontrol.
- Implement complex automated routines using workfloworchestration tools.
- Work with geographically diverse teams in different timezones to identify technical bottlenecks and provide efficient solutions that adhereto our unified data model standards.
- Drive the implementation of new data projects and theoptimization of existing solutions.
- Design and own ML model operationalization in productionenvironment in close collaboration with ML Scientists.
- Help design and manage REST API in the cloud to supportML recommendation engine.
- Educate and promote best practices around dataengineering on decentralized and geographically diverse teams.
What you’ll need to be successful :
5+ years of experience in engineering, especially datainfrastructure and data engineering.Strong experience with Python & RDBMS likePostgreSQL, MySQL, and SQL Server.Strong experience in a cloud environment like AWS, Snowflake,and familiarity with tools like Airflow, DBT.Experience with design, development, and implementationof highly scalable, high-volume software systems and components, source oftruth systems for different business areas, developing and maintaining webservices in an agile environment.Experience with data warehouse solutions (likeSnowflake / Redshift)Familiarity with AWS specifically for Model DevOps andData-Pipelining is a big plus.Experience putting ML models through production incorporate environments.Experience with data visualization tools andinfrastructures (like Tableau / PowerBI).Perks & Benefits :
Friendly, talented, collaborative, and entrepreneurialteamPremium medical, dental, and vision insuranceGenerous holiday and PTO policies401k matching programLunchTechnology stipendsWellness allowanceTraining and development opportunities and allowanceFun and inclusive digital, and (in the future) in-personeventsEmployee groups - DEI committee, fun committee, wellnessgroup and moreFlexible remote work