Sr. Data Engineer

Job DescriptionRoles and ResponsibilitiesThe open position is for Data Science and Analytics team within Business Transformation and IT Systems department with the following roles and responsibilities :

• Integrate new sources of data into our central data warehouse, and moving data out to applications
• Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions
• Monitor, analyze and improve performance of operations and build CI / CD processes
• Build and maintain optimized and highly available data pipelines that facilitate deeper analysis
• Manage pipelines in support of data and analytics projects
• Design and build data model
• Maintain a data warehouse and analytics environment
• Manage master data, including creation, updates, and deletion
• Manage users and user roles
• Provide quality assurance of imported data, working with respective stakeholders if necessary
• Commission and decommission of data sets
• Writing scripts for data integration and analysis
• Manage and design the reporting environment, including data sources, security, and metadata
• Support initiatives for data integrity and normalization
• Troubleshoot the reporting database environment and reports
• Evaluate changes and updates to source production systems
• Provide technical expertise in data storage structures and data cleansingJob Requirement
• Bachelor’s degree from an accredited university or college in computer science or other quantitative fields.
• 4+ years of work experience as a Data Engineer, Big Data Consultant or in a related field
• Must have demonstrated experience in building and maintaining reliable and scalable ETL on big data platforms as well as experience working with varied forms of data infrastructure inclusive of relational databases such as SQL, Hadoop, Spark.
• High-level experience in methodologies and processes for managing large-scale databases
• Hands-on experience in Azure or Databricks will an added advantage