EY GDS Consulting AI And DATA GCP Senior

At EY youll have the chance to build a career as unique as you are with the global scale support inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better too. Join us and build an exceptional experience for yourself and a better working world for all.

The opportunity

We are seeking an experienced GCP Data Engineer with strong technology and data understanding in GCP engineering space having proven delivery capability. The candidate will be responsible for building maintaining and optimizing data pipelines and data platforms on Google Cloud (Big Query). The role will focus on data ingestion transformation orchestration automation and analytics enablement for enterprise-scale solutions.

Your Technical responsibilities:

• Design and develop scalable ETL/ELT pipelines on GCP
• Build and maintain data ingestion and transformation frameworks using BigQuery and GCP services
• Develop Cloud Functions and automation scripts for data movement and processing
• Create and maintain workflows using Cloud Composer/Airflow
• Implement data reconciliation validation and data quality controls
• Troubleshoot pipeline failures and performance issues using monitoring and logging tools
• Support migration of on-premises or legacy workloads to GCP
• Create dashboards reports and analytics solutions for business users
• Collaborate with business architecture and development teams to deliver data-driven solutions.
• Use Data flow or STS to build pipeline from traditional and cloud source to GCP.
• Good understanding of cloud design considerations and FinOps
• Proficient in a modern scripting language like Python Spark and Scala.
• Work with container technology such as Docker version control systems (Github) build management and CI/CD tools (Concourse Jenkins)
• Data Pipeline Workflows: Build and maintain data pipelines using tools and services like Dataflow Dataproc Apache Beam Apache Airflow Cloud Composer etc. to collect process and distribute data.
• CI/CD Implementation: Implement CI/CD pipelines for data applications using services like Cloud Build Jenkins or Gitlab. Continuous testing continuous integration build package and deployment should be automated across multi-cloud environments.
• Code Management: Take charge of source code repositories like GitHub or Bitbucket ensuring robust version control practices.
• Data Security & Compliance: Implement security best practices. Handle actions such as encryption managing and securing service accounts secret management (like with Secret Manager) authentication access control and data compliance necessities (like GDPR).
• Performance Optimization and Cost Control: Monitor debug troubleshoot and optimize performance of Dataflow jobs and other data infrastructure. Implement strategies for optimizing cost across multiple clouds.
• Data Lakes and Data Warehouses Management: Manage BigQuery or other cloud data warehouse solutions and services for Data Lakes.

Mandatory Requirements (Qualifications)

We are looking for the candidates with the following:

• BE/BTech/MCA with a sound industry experience of 5 to 8 years
• 36 years of Data Engineering experience with hands-on GCP implementation
• Programming Language- Python SQL Spark (PySpark)
• Experience in FS domain- preferably asset wealth management
• Experience with CI/CD pipelines and cloud-native development practices.
• Exposure to Apache Spark Databricks and modern data engineering frameworks.
• Strong communication skills
• Google Cloud Certified is add-on

EY Building a better working world

EY exists to build a better working world helping to create long-term value for clients people and society and build trust in the capital markets.

Enabled by data and technology diverse EY teams in over 150 countries provide trust through assurance and help clients grow transform and operate.

Working across assurance consulting law strategy tax and transactions EY teams ask better questions to find new answers for the complex issues facing our world today.

Employment Type : Full Time
Experience: years
Vacancy: 1