We are currently seeking a seasoned GCP Cloud Data Engineer with 3 to 5 years of experience in leading / implementing GCP data projects, preferrable implementing complete data centric model. This position is to design & deploy Data Centric Architecture in GCP for Materials Management platform which would get / give data from multiple applications modern & Legacy in Product Development, Manufacturing, Finance, Purchasing, N-Tier supply Chain, Supplier collaboration Design and implement data-centric solutions on Google Cloud Platform (GCP) using various GCP tools like Storage Transfer Service, Cloud Data Fusion, Pub / Sub, Data flow, Cloud compression, Cloud scheduler, Gutil, FTP / SFTP, Dataproc, BigTable etc.
- Build ETL pipelines to ingest the data from heterogeneous sources into our system
- Develop data processing pipelines using programming languages like Java and Python to extract, transform, and load (ETL) data
- Create and maintain data models, ensuring efficient storage, retrieval, and analysis of large datasets
- Deploy and manage databases, both SQL and NoSQL, such as Bigtable, Firestore, or Cloud SQL, based on project requirements infrastructure.
Skill Required :
GCP Data Engineer, Hadoop, Spark / Pyspark, Google Cloud Platform (Google Cloud Platform) services : BigQuery, DataFlow, Pub / Sub, BigTable, Data Fusion, DataProc, Cloud Compose, Cloud SQL, Compute Engine, Cloud Functions, and App Engine.4+ years of professional experience in : o Data engineering, data product development and software product launches.3+ years of cloud data / software engineering experience building scalable, reliable, and cost- effective production batch and streaming data pipelines using :Data warehouses like Google BigQuery.Workflow orchestration tools like Airflow.Relational Database Management System like MySQL, PostgreSQL, and SQL Server.Real-Time data streaming platform like Apache Kafka, GCP Pub / Sub.Education Required :
Any Bachelors' degree
Skills Required
data engineering , Google Cloud Platform, Programming Languages