GCP Data Engineer

Key Responsibilities :

• Design, develop, and maintain scalable data pipelines and ETL processes using GCP services such as BigQuery, Cloud Data Fusion, Dataflow, Pub / Sub, Cloud Storage, Composer ,Cloud Function, Cloud RUN
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Implement data integration solutions to ingest, process, and store large volumes of structured and unstructured data from various sources.
• Optimize and tune data pipelines for performance, reliability, and cost-efficiency.
• Ensure data quality and integrity through data validation, cleansing, and transformation processes.
• Develop and maintain data models, schemas, and metadata to support data analytics and reporting.
• Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal disruption to data workflows.
• Stay up-to-date with the latest GCP technologies and best practices, and provide recommendations for continuous improvement.
• Mentor and guide junior data engineers, fostering a culture of knowledge sharing and collaboration.

Qualifications :