Job Description :
We are seeking a skilled and experienced GCP Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust and scalable data pipelines and data solutions on the Google Cloud Platform (GCP). This role requires a strong understanding of data warehousing principles and hands-on experience with a range of GCP's core data services.
Key Responsibilities :
- Design, develop, and maintain efficient and reliable data pipelines using GCP's data services.
- Write complex and optimized queries and scripts using Python, SQL, and PySpark for data extraction, transformation, and loading (ETL / ELT).
- Utilize and manage key GCP data tools, including BigQuery for data warehousing and analysis, Dataproc for big data processing, and Cloud Storage for data lake solutions.
- Orchestrate and automate data workflows using Cloud Composer (Apache Airflow).
- Collaborate with data scientists, analysts, and other engineers to understand data requirements and deliver solutions that meet
business needs.
Monitor, troubleshoot, and optimize data pipeline performance and efficiency.Ensure data quality, integrity, and security across all data solutions.Stay up-to-date with the latest developments in GCP data services and best practices.Required Skills & Qualifications :
Experience : 4+ years of professional experience in data engineering, with a strong focus on Google Cloud Platform.Technical Skills :
Strong proficiency in Python, SQL, and PySpark.Hands-on experience with key GCP data services, including BigQuery, Dataproc, Cloud Storage, and Cloud Composer.Solid understanding of data warehousing, data modeling, and ETL / ELT processes.Experience with big data concepts and distributed computing frameworks.Soft Skills :
Excellent problem-solving and analytical abilities.Strong communication and collaboration skills to work effectively with cross-functional teams.Proactive and adaptable, with a passion for continuous learning in a fast-paced environment.(ref : hirist.tech)