GCP Data Engineer
Work Location : Noida / Chandigarh / Pune / Chennai / Remote
Salary up to 30 LPA
We are seeking an experienced GCP Data Engineer to join our team. The ideal candidate will work closely with business, IT, analysts, and data science groups to collect requirements and build high-performance data pipelines. This role involves designing scalable data solutions, ensuring data quality, and supporting real-time data ingestion using Google Cloud Platform services.
Key Responsibilities :
- Work closely with various business, IT, analyst, and data science groups to collect business requirements.
- Design, develop, deploy, and support high-performance data pipelines (inbound and outbound).
- Model data platform by applying business logic and building objects in the semantic layer.
- Optimize data pipelines for performance, scalability, and reliability.
- Implement CI / CD pipelines to ensure continuous deployment and delivery of data products.
- Ensure quality of critical data elements and collaborate with business / system owners on remediation plans.
- Document the design and support strategy of data pipelines.
- Capture, store, and socialize data lineage and operational metadata.
- Troubleshoot and resolve data engineering issues.
- Develop REST APIs to expose data to other teams.
- Mentor and guide junior data engineers.
Required Qualifications :
2+ years of experience in Google Cloud with services like BigQuery, Composer, GCS, DataStream, and Dataflows.6+ years of experience in data engineering solutions such as data platforms, ingestion, data management, or publication / analytics.Knowledge, Skills & Abilities :
Expert knowledge of SQL and Python programming.Experience working with Airflow as a workflow management tool and building operators to connect, extract, and ingest data.Experience in tuning queries for performance and scalability.Experience in real-time data ingestion using GCP PubSub, Kafka, Spark, or similar.Excellent organizational, prioritization, and analytical abilities.Proven experience with incremental execution through successful launches.Excellent problem-solving and critical-thinking skills; ability to comprehend complex data issues across multiple business environments.Experience working in an Agile environment.