Senior Python Developer - Google Cloud Platform

Job Summary :

We are seeking an experienced Senior Python Developer with deep expertise in Google Cloud Platform (GCP), PySpark, and Apache Airflow. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, orchestrating complex workflows using Airflow, and optimizing data processing jobs in a distributed environment.

Key Responsibilities :

• Design and develop robust, scalable, and efficient data pipelines using Python and PySpark.
• Create, schedule, and monitor DAGs in Apache Airflow for data workflow orchestration.
• Work with GCP services (such as BigQuery, Cloud Composer, GCS, Pub / Sub, Dataflow, etc.) to build end-to-end data solutions.
• Implement data transformation, cleansing, aggregation, and validation logic in pipelines.
• Collaborate with Data Engineers, Analysts, and other stakeholders to understand business requirements and translate them into technical solutions.
• Optimize performance and cost-efficiency of data pipelines on GCP.
• Monitor production workflows and troubleshoot issues to ensure data accuracy and availability.
• Follow coding best practices and maintain high standards for data quality, security, and compliance.
• Participate in code reviews, testing, and deployment processes in CI / CD environments.

Required Skills :

Preferred Qualifications :

(ref : hirist.tech)