We are seeking an experienced GCP Data Engineer with expertise in Dataproc and BigQuery to join our team in India. The ideal candidate will have a strong background in designing and implementing data pipelines that support data analytics and business intelligence initiatives.
Responsibilities
- Designing, building, and maintaining scalable data pipelines on Google Cloud Platform (GCP) using Dataproc and BigQuery.
- Collaborating with data scientists and analysts to understand data requirements and provide solutions.
- Optimizing data storage and retrieval processes for efficiency and performance in BigQuery.
- Implementing data governance and security measures to protect sensitive information.
- Monitoring and troubleshooting data pipeline performance and issues.
- Conducting data quality checks and ensuring the integrity of data processed through GCP services.
Skills and Qualifications
8-10 years of experience in data engineering or related field.Strong proficiency in GCP services, specifically Dataproc and BigQuery.Experience with ETL processes and data modeling.Proficient in SQL and familiarity with programming languages such as Python or Java.Knowledge of data warehousing concepts and best practices.Experience in working with large datasets and distributed data processing frameworks.Familiarity with data governance and security best practices.Excellent problem-solving skills and ability to work in a team-oriented environment.Skills Required
BigQuery, Dataproc, Data Warehousing, Sql, Cloud Architecture, Python