Cymetrix Software - Google Cloud Platform Data Engineer

GCP Skills :

• GCP - GCS, PubSub, Dataflow or DataProc, Bigquery, BQ optimization, Airflow / Composer, Python(preferred) / Java
• ETL on GCP Cloud - Build pipelines (Python / Java) + Scripting, Best Practices, Challenges
• Knowledge of Batch and Streaming data ingestion, build End to Data pipelines on GCP
• Knowledge of Databases (SQL, NoSQL), On-Premise and On-Cloud, SQL vs No SQL, Types of No-SQL DB (At Least 2 databases)
• Data Warehouse concepts - Beginner to Intermediate level
• Data Modeling, GCP Databases, DB Schema(or similar)
• Hands-on data modelling for OLTP and OLAP systems
• In-depth knowledge of Conceptual, Logical and Physical data modelling
• Strong understanding of Indexing, partitioning, data sharding, with practical experience of having done the same
• Strong understanding of variables impacting database performance for near-real-time reporting and application interaction.
• Should have working experience on at least one data modelling tool, preferably DBSchema, Erwin
• Good understanding of GCP databases like AlloyDB, CloudSQL, and BigQuery.
• People with functional knowledge of the mutual fund industry will be a plus Should be willing to work from Chennai, office presence is & Responsibilities :
• Work with business users and other stakeholders to understand business processes.
• Ability to design and implement Dimensional and Fact tables
• Identify and implement data transformation / cleansing requirements
• Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data Warehouse
• Develop conceptual, logical, and physical data models with associated metadata including data lineage and technical data definitions
• Design, develop and maintain ETL workflows and mappings using the appropriate data load technique
• Provide research, high-level design, and estimates for data transformation and data integration from source applications to end-user BI solutions.
• Provide production support of ETL processes to ensure timely completion and availability of data in the data warehouse for reporting use.
• Analyze and resolve problems and provide technical assistance as necessary.
• Partner with the BI team to evaluate, design, develop BI reports and dashboards according to functional specifications while maintaining data integrity and data quality.
• Work collaboratively with key stakeholders to translate business information needs into well-defined data requirements to implement the BI solutions.
• Leverage transactional information, data from ERP, CRM, HRIS applications to model, extract and transform into reporting & analytics.
• Define and document the use of BI through user experience / use cases, prototypes, test, and deploy BI solutions.
• Develop and support data governance processes, analyze data to identify and articulate trends, patterns, outliers, quality issues, and continuously validate reports, dashboards and suggest improvements.
• Train business end-users, IT analysts, and : Google Cloud Platform (GCP), bigquery, Data modeling, Snow flake schema, OLTP and OLAP

ref : hirist.tech)