Palni - Senior Cloud Developer

Job Description :

We are seeking a Senior Cloud Developer with strong expertise in Java (v17+), Google Cloud Platform (GCP), and data engineering frameworks. The candidate will design, develop, and deploy scalable data processing pipelines and orchestration workflows, ensuring high performance, reliability, and maintainability across large-scale systems.

Key Responsibilities :

• Design, develop, test, and deploy scalable and reliable data processing pipelines using Java 17+ and Apache Beam, executed on GCP Cloud Dataflow.
• Build and manage complex data orchestration workflows using Apache Airflow or GCP Cloud Composer, including creating and maintaining DAGs with various common and custom operators.
• Interact with and optimize data stored in GCP Big Data services such as BigQuery, BigTable, and Google Cloud Storage (GCS).
• Write, optimize, and review complex SQL queries for data retrieval, transformation, and analysis-primarily within BigQuery and Cloud SQL.
• Ensure adherence to code quality, testing standards, and technical documentation. (Added Advantage) Deploy and manage applications on GKE (Google Kubernetes Engine), manage security and permissions through GCP IAM, work with Cloud Spanner, and develop secure APIs for data access.
Mandatory Skills :
• Java 17+
• GCP - Cloud Dataflow (Apache Beam programming)
• Airflow / Cloud Composer - Creation and maintenance of DAGs and common operators
• GCP Big Data Services - BigQuery, BigTable, GCS, Cloud SQL
• Strong SQL programming and optimization skills

(ref : hirist.tech)