Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title And Summary
Senior Data Engineer - (On Premises - Hadoop, Spark, Python, SQL)
Who is Mastercard
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.
Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.
Role : As the Senior Data Engineer for Mastercard's Internal Workplace intelligence platform data lake, you will be the driving force behind the development and execution of cutting-edge data governance strategies and data environment frameworks.
Your expertise will ensure the effective utilization of data, enabling the delivery of dependable Data & Analytics Services. You will collaborate with cross-functional teams, and establish data-related best practices in alignment with Mastercard standards.
Qualifications :
- Bachelor's degree in Computer Science, Engineering, Data Science, or a related field.
- Proven experience as a Lead / Senior Data Engineer or similar role.
- Deep understanding of data governance principles and data lifecycle management.
- Proficiency in designing and implementing data tools, technologies, and processes.
- Expertise in data engineering, ETL / ELT processes, data warehousing, and data modeling.
- Strong command of data integration techniques and data quality management.
- Hands-on experience with data technologies such as Hadoop, Spark, Python, SQL, alteryx, Nifi, SSIS, etc.
- Familiarity with cloud platforms and services, such as AWS, GCP, or Azure.
- Excellent problem-solving skills and ability to provide innovative data solutions.
- Strong leadership skills with a proven track record of guiding and mentoring a team.
All About You :
5-8 years of experience in Data Warehouse related projects in product or service-based organizationExpertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data Hadoop environmentExperience of building data pipelines through Spark with Scala / Python / Java on Hadoop or Object storageExperience of working with Databases like MS SQL Server, Oracle and have strong SQL knowledgeExperience of working on Alteryx, SSIS, NiFi added advantageExperience of working on automation in data flow process in a Big Data environment.Experience of working in Agile teamsStrong analytical skills required for debugging production issues, providing root cause and implementing mitigation planStrong communication skills - both verbal and written – and strong relationship, collaboration skills and organizational skillsAbility to multi-task across multiple projects, interface with external / internal resources and provide technical leadership to junior team membersAbility to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive resultsAbility to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statementFlexibility to work as a member of a matrix based diverse and geographically distributed project teamsCreate and maintain a robust data environment that adheres to Mastercard standards and best practices.Oversee the management and optimization of data warehouses and data lakes.Attributes :
Strong communication skills with the ability to convey complex technical concepts to non-technical stakeholders.Detail-oriented and committed to maintaining high data quality and integrity.Proactive attitude towards problem-solving and continuous improvement.Results-driven with a focus on delivering reliable and valuable Data & Analytics Services.Ability to lead and inspire a team to achieve exceptional results.Collaborative and adaptable, thriving in a dynamic and fast-paced environment.Abide by Mastercard's security policies and practices;Ensure the confidentiality and integrity of the information being accessed;Report any suspected information security violation or breachComplete all periodic mandatory security trainings in accordance with Mastercard's guidelines.Responsibilities :
Participate in team prioritization discussions with Product / Business stakeholdersEstimate and own delivery tasks (design, dev, test, deployment, configuration, documentation) to meet the business requirementsAutomate build, operate, and run aspects of softwareDrive code / design / process trade-off discussions within their team when requiredReport status and manage risks within their primary application / serviceDrive integration of services focusing on customer journey and experiencePerform demos / acceptance discussions in interacting with Product ownersUnderstands operational and engineering experience, actively works to improve experience and metrics in ownership areaDevelop complete understanding of end-to-end technical architecture and dependency systemsDrive adoption of technology standards and opinionated frameworks, and review coding, test, and automation work of team membersMentor and guide new and less-experienced team membersIdentify opportunities to improve an overall process and trim wasteShare and seek knowledge within their Guild / Program to drive reuse of patterns / libraries / practices and enhance productivityCorporate Security Responsibility
All Activities Involving Access To Mastercard Assets, Information, And Networks Comes With An Inherent Risk To The Organization And, Therefore, It Is Expected That Every Person Working For, Or On Behalf Of, Mastercard Is Responsible For Information Security And Must :
Abide by Mastercard's security policies and practices;Ensure the confidentiality and integrity of the information being accessed;Report any suspected information security violation or breach, andComplete all periodic mandatory security trainings in accordance with Mastercard's guidelines.Skills Required
data engineering , Hadoop, Data Modeling, Alteryx, Ssis, Sql, ELT, Spark, Data Warehousing, Python, Etl