We are seeking a talented and passionate Data Engineer to join our growing data team. In this role, you will be responsible for building, maintaining, and optimizing our data pipelines and infrastructure on Google Cloud Platform (GCP). The ideal candidate will have a strong background in data warehousing, ETL / ELT processes, and a passion for turning raw data into actionable insights. You will work closely with data scientists, analysts, and other engineers to support a variety of data-driven :
- Design, develop, and maintain scalable and reliable data pipelines using Dataform or DBT.
- Build and optimize data warehousing solutions on Google BigQuery.
- Develop and manage data workflows using Apache Airflow.
- Write complex and efficient SQL queries for data extraction, transformation, and analysis.
- Develop Python-based scripts and applications for data processing and automation.
- Collaborate with data scientists and analysts to understand their data requirements and provide solutions.
- Implement data quality checks and monitoring to ensure data accuracy and consistency.
- Optimize data pipelines for performance, scalability, and cost-effectiveness.
- Contribute to the design and implementation of data infrastructure best practices.
- Troubleshoot and resolve data-related issues.
- Stay up-to-date with the latest data engineering trends and technologies, particularly within the Google Cloud :
- Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.
- 3-4 years of experience in a Data Engineer role.
- Strong expertise in SQL (preferably with BigQuery SQL).
- Proficiency in Python programming for data manipulation and automation.
- Hands-on experience with Google Cloud Platform (GCP) and its data services.
- Solid understanding of data warehousing concepts and ETL / ELT methodologies.
- Experience with Dataform or DBT for data transformation and modeling.
- Experience with workflow management tools such as Apache Airflow.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Ability to work independently and as part of a team.
Preferred Qualifications :
Google Cloud Professional Data Engineer certification.Knowledge of data modeling techniques (e.g., dimensional modeling, star schema).Familiarity with Agile development methodologies(ref : hirist.tech)