We are seeking an experienced Data Engineer with strong expertise in Google Cloud Platform (GCP) technologies to join our growing data engineering team. The ideal candidate should have at least 8 years of experience in data engineering, data processing, and cloud-based data solutions, with hands-on experience in designing, developing, and maintaining scalable data pipelines and analytics platforms.
The candidate will be responsible for building and managing large-scale data processing solutions using Google Cloud Platform services such as Dataflow and BigQuery. The role requires strong programming skills in Java and the ability to develop high-performance data ingestion, transformation, and processing frameworks that support business intelligence, analytics, and operational reporting requirements.
The successful candidate should have extensive experience working with structured and semi-structured data and should be capable of designing efficient data pipelines that can process large volumes of data in both batch and real-time environments. They will work closely with business stakeholders, data analysts, architects, and application teams to understand data requirements and deliver scalable and reliable data solutions.
A strong understanding of Google Cloud Platform is mandatory. The candidate should have hands-on experience with GCP services and be able to leverage cloud-native technologies to build secure, scalable, and cost-effective data processing solutions. Experience with Dataflow is essential for developing and managing distributed data processing jobs, while BigQuery expertise is required for designing and optimizing enterprise data warehouses and analytical solutions.
Key Responsibilities :
- Design, develop, and maintain scalable data pipelines using Google Cloud Platform technologies.
- Build and optimize data processing solutions using Google Cloud Dataflow.
- Design, develop, and maintain enterprise-scale data warehouses using BigQuery.
- Develop data transformation and processing logic using Java.
- Integrate data from multiple internal and external sources into cloud-based data platforms.
- Optimize data processing performance, storage utilization, and query efficiency.
- Monitor, troubleshoot, and resolve data pipeline issues in production environments.
- Collaborate with business stakeholders to understand data requirements and deliver effective solutions.
- Ensure data quality, integrity, security, and compliance across all data platforms.
- Participate in code reviews, testing, deployment, and production support activities.
- Create technical documentation and maintain data architecture artifacts.
Mandatory Skills :
- Strong hands-on experience with Google Cloud Platform (GCP).
- Experience with Google Cloud Dataflow.
- Strong expertise in BigQuery.
- Proficiency in Java programming.
- Experience designing and developing cloud-based data engineering solutions.
- Strong understanding of distributed data processing concepts.
Good-to-Have Skills :
- ETL development and data integration experience.
- Data Warehousing concepts and implementation experience.
- Experience with dimensional data modeling.
- Exposure to real-time data processing frameworks.
- Knowledge of cloud security and governance practices.
- Experience working in Agile environments.
Experience Required :
- Minimum 8 years of overall IT experience.
- Relevant experience in Data Engineering and GCP technologies.
- Experience working on large-scale enterprise data platforms and analytics solutions.
GCP Data Engineer - ETL/Data Warehousing • Coimbatore
Clients need a single point of contact who actually understands hardware, not just a relationship manager who has to relay every technical question.Projects span hardware deployment, structured cab... Show more
DIRECT REPORTING: TEAM LEAD – ENGINEERING.The candidate will be part of the Industrial Valves Engineering team, supporting creation of Bills of materials, 3D CAD models and Engineering drawings for... Show more
