GCP Data Engineer

Key Responsibilities :

Design, develop, and maintain scalable data pipelines and ETL processes using GCP services such as BigQuery, Cloud Data Fusion, Dataflow, Pub / Sub, Cloud Storage, Composer ,Cloud Function, Cloud RUN

Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.

Implement data integration solutions to ingest, process, and store large volumes of structured and unstructured data from various sources.

Optimize and tune data pipelines for performance, reliability, and cost-efficiency.

Ensure data quality and integrity through data validation, cleansing, and transformation processes.

Develop and maintain data models, schemas, and metadata to support data analytics and reporting.

Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal disruption to data workflows.

Stay up-to-date with the latest GCP technologies and best practices, and provide recommendations for continuous improvement.

Mentor and guide junior data engineers, fostering a culture of knowledge sharing and collaboration.

Qualifications :

Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

4 to 6 years of experience in data engineering, with a strong focus on GCP.

Proficiency in GCP services such as BigQuery, Cloud Data Fusion, Dataflow, Pub / Sub, Cloud Storage, Composer ,Cloud Function, Cloud RUN.

Strong programming skills in Python, PLSQL.

Experience with SQL and NoSQL databases.

Knowledge of data warehousing concepts and best practices.

Familiarity with data integration tools and frameworks.

Excellent problem-solving and analytical skills.

Strong communication and collaboration skills.

Ability to work in a fast-paced, dynamic environment.