It's fun to work in a company where people truly BELIEVE in what they are doing!
Responsibilities
- Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks leveraging open source tools and data processing frameworks.
- Hands-on on technologies such as Kafka, Apache Spark (SQL, Scala, Java), Python, Hadoop Platform, Hive, Presto, Druid, airflow
- Deep understanding of BigQuery architecture, best practices, and performance optimization.
- Proficiency in LookML for building data models and metrics.
- Experience with DataProc for running Hadoop / Spark jobs on GCP.
- Knowledge of configuring and optimizing DataProc clusters.
- Offer system support as part of a support rotation with other team members.
- Operationalize open source data-analytic tools for enterprise use.
- Ensure data governance policies are followed by implementing or validating data lineage, quality checks, and data classification.
- Understand and follow the company development lifecycle to develop, deploy and deliver the solutions.
Minimum Qualifications :
Bachelor's degree in Computer Science, CIS, or related fieldExperience on project(s) involving the implementation of software development life cycles (SDLC) GCP DATA ENGINEERRequired Skills & Qualifications :
Education : Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.7+ years of experience in data engineering, cloud data solutions, and pipeline development.GCP Expertise : Hands-on experience with BigQuery, Dataflow, Pub / Sub, Cloud Storage, Cloud Composer (Airflow), Vertex AI, and IAM Policies.Programming : Proficiency in Python, SQL, and Apache Beam (Java or Scala is a plus).If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Not the right fit? Let us know you're interested in a future opportunity by clickingin the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!