Job Roles and Responsibilities :
What You’ll Do :
You are an experienced Software Engineer, Data / Data Engineer who’s passionate about developing products that are simple, intuitive, and beautiful. You will be making an impact on HG’s core data platform / processing engine using modern Big Data techniques particularly working with enterprise applications for B2B. We are a small engineering focused team who are delivering innovative features in a fast-growing market. We build Big Data systems utilizing cutting edge technologies and solutions that allow our developers to learn and develop while shipping amazing products.
You will be involved in building data pipelines at a large scale to enable business teams to work with data and analyze metrics that support and drive the business. You will partner with cross functional teams to identify opportunities and continuously develop and improve processes for efficiency.
What You'll Be Responsible For :
- Collaborating with Product Development Teams to build the most effective solutions
- Developing and enhancing features in our databases, backend apps, front end UI, and Data as a Service (DAAS) product
- Building data pipelines to support our data ingesting, cleansing, enriching, and presentation efforts in support of our flagship SaaS applications
- Authoring and scheduling workflows monitored by Airflow
- Responsible for the design and architecture of data collection
- Collaborating with cross-functional teams to design and implement impactful solutions to department and business problems
- Support end users and teammates on code-related questions and issues
- Attend daily stand-up meetings, planning sessions, encourage others, and collaborate at a rapid pace
What You’ll Need :
BS, MS, or in Computer Science or related technical discipline2+ years of experience in data engineering, or an equivalent combination of education and experienceExperience using Scala / Java, Spark, Airflow and Hadoop are essential for success in this position2 or more years of designing and programming in a work settingAdvanced experience in SQL of any flavor (MySQL,Postgres, Snowflake, Sql server etc)Proficient in Java or Scala (understand and have real-world experience with design patterns)Experience with Amazon Web Services (EC2, S3, RDS, EMR, ELB etc.) or similar cloud platformsExperience with web services using RESTComfortable working with CI / CD and automation environments such as Docker, Kubernetes, Terraform or similarUnderstand pragmatic agile development practicesProven track record of successful project delivery