Talent.com
Senior Data Engineer - (On Premises - Hadoop, Spark, Python, SQL)

Senior Data Engineer - (On Premises - Hadoop, Spark, Python, SQL)

ConfidentialPune, India
7 days ago
Job description

Our Purpose

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Title And Summary

Senior Data Engineer - (On Premises - Hadoop, Spark, Python, SQL)

Who is Mastercard

Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.

Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.

Role : As the Senior Data Engineer for Mastercard's Internal Workplace intelligence platform data lake, you will be the driving force behind the development and execution of cutting-edge data governance strategies and data environment frameworks.

Your expertise will ensure the effective utilization of data, enabling the delivery of dependable Data & Analytics Services. You will collaborate with cross-functional teams, and establish data-related best practices in alignment with Mastercard standards.

Qualifications :

  • Bachelor's degree in Computer Science, Engineering, Data Science, or a related field.
  • Proven experience as a Lead / Senior Data Engineer or similar role.
  • Deep understanding of data governance principles and data lifecycle management.
  • Proficiency in designing and implementing data tools, technologies, and processes.
  • Expertise in data engineering, ETL / ELT processes, data warehousing, and data modeling.
  • Strong command of data integration techniques and data quality management.
  • Hands-on experience with data technologies such as Hadoop, Spark, Python, SQL, alteryx, Nifi, SSIS, etc.
  • Familiarity with cloud platforms and services, such as AWS, GCP, or Azure.
  • Excellent problem-solving skills and ability to provide innovative data solutions.
  • Strong leadership skills with a proven track record of guiding and mentoring a team.

All About You :

  • 5-8 years of experience in Data Warehouse related projects in product or service-based organization
  • Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data Hadoop environment
  • Experience of building data pipelines through Spark with Scala / Python / Java on Hadoop or Object storage
  • Experience of working with Databases like MS SQL Server, Oracle and have strong SQL knowledge
  • Experience of working on Alteryx, SSIS, NiFi added advantage
  • Experience of working on automation in data flow process in a Big Data environment.
  • Experience of working in Agile teams
  • Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
  • Strong communication skills - both verbal and written – and strong relationship, collaboration skills and organizational skills
  • Ability to multi-task across multiple projects, interface with external / internal resources and provide technical leadership to junior team members
  • Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and     self-motivation to drive results
  • Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement
  • Flexibility to work as a member of a matrix based diverse and geographically distributed project teams
  • Create and maintain a robust data environment that adheres to Mastercard standards and best practices.
  • Oversee the management and optimization of data warehouses and data lakes.
  • Attributes :

  • Strong communication skills with the ability to convey complex technical concepts to non-technical stakeholders.
  • Detail-oriented and committed to maintaining high data quality and integrity.
  • Proactive attitude towards problem-solving and continuous improvement.
  • Results-driven with a focus on delivering reliable and valuable Data & Analytics Services.
  • Ability to lead and inspire a team to achieve exceptional results.
  • Collaborative and adaptable, thriving in a dynamic and fast-paced environment.
  • Abide by Mastercard's security policies and practices;
  • Ensure the confidentiality and integrity of the information being accessed;
  • Report any suspected information security violation or breach
  • Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.
  • Responsibilities :

  • Participate in team prioritization discussions with Product / Business stakeholders
  • Estimate and own delivery tasks (design, dev, test, deployment, configuration, documentation) to meet the business requirements
  • Automate build, operate, and run aspects of software
  • Drive code / design / process trade-off discussions within their team when required
  • Report status and manage risks within their primary application / service
  • Drive integration of services focusing on customer journey and experience
  • Perform demos / acceptance discussions in interacting with Product owners
  • Understands operational and engineering experience, actively works to improve experience and metrics in ownership area
  • Develop complete understanding of end-to-end technical architecture and dependency systems
  • Drive adoption of technology standards and opinionated frameworks, and review coding, test, and automation work of team members
  • Mentor and guide new and less-experienced team members
  • Identify opportunities to improve an overall process and trim waste
  • Share and seek knowledge within their Guild / Program to drive reuse of patterns / libraries / practices and enhance productivity
  • Corporate Security Responsibility

    All Activities Involving Access To Mastercard Assets, Information, And Networks Comes With An Inherent Risk To The Organization And, Therefore, It Is Expected That Every Person Working For, Or On Behalf Of, Mastercard Is Responsible For Information Security And Must :

  • Abide by Mastercard's security policies and practices;
  • Ensure the confidentiality and integrity of the information being accessed;
  • Report any suspected information security violation or breach, and
  • Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.
  • Skills Required

    data engineering , Hadoop, Data Modeling, Alteryx, Ssis, Sql, ELT, Spark, Data Warehousing, Python, Etl

    Create a job alert for this search

    Senior Data Engineer • Pune, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Coditaspune, maharashtra, in
    Understand Business requirements and implement scalable solutions.Translate complex technical and functional requirements into detailed designs. Develop a highly scalable, reliable, and high-perform...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear CorporationPune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show moreLast updated: 9 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mastekpune, maharashtra, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Persistent Systemspune, maharashtra, in
    We are seeking a Senior Platform Engineer to architect, build, and manage enterprise-scale data platforms that power advanced analytics and AI initiatives. This role blends cloud engineering, DevOps...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer - PySpark

    Senior Data Engineer - PySpark

    Xlr8 Talent SearchPune
    Job Description : We are looking for a Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and distributed computing to develop ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Guidanz IncPune, IN
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Innova Solutionspune, maharashtra, in
    We're Hiring : Lead Data Consultant / Senior Data Engineer.Industry : Financial Services & Insurance (FSI).Are you passionate about building scalable, cloud-native data platforms? Join our team to le...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent SystemsPune, Maharashtra, India
    A highly skilled Data Engineering professional with 6 to 8 years of experience in designing, developing, and maintaining robust data solutions. Proven ability to work across the full software develo...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Copune, maharashtra, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 4 days ago
    • Promoted
    Senior Databricks Engineer

    Senior Databricks Engineer

    Newscape ConsultingPune, Maharashtra, India
    The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data ecos...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Senior Data Engineer – Cloud Data Solutions

    Senior Data Engineer – Cloud Data Solutions

    Elongo Global Solutionspune, maharashtra, in
    SQL, Talend, Google Cloud Platform (GCP) BigQuery.In this role, you’ll be responsible for designing, developing, and optimizing high-performance data pipelines and cloud-based data architectures th...Show moreLast updated: 16 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIPune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivepune, maharashtra, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Apptwarepune, maharashtra, in
    The ideal candidate will take ownership of our end-to-end data strategy, ensuring scalability, reliability, and performance across multiple data systems. Redshift or PostgreSQL, DynamoDB, and Docume...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer- AWS

    Senior Data Engineer- AWS

    InfoCeptsPune, Maharashtra, India
    Key Result Areas and Activities : .Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements. Should be able to design comple...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasPune, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer (ADB + Snowflake)

    Senior Data Engineer (ADB + Snowflake)

    Persistent Systemspune, maharashtra, in
    We are looking for a highly skilled and innovative Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and Snowflake, along with hands-on experience integrating AI tools such a...Show moreLast updated: 22 days ago
    • Promoted
    Coditas - Senior Data Engineer - Python

    Coditas - Senior Data Engineer - Python

    Coditas Technologies Pvt. Ltd.Pune
    Roles and Responsibilities : - Understand Business requirements and implement scalable solutions.Translate complex technical and functional requirements into detailed...Show moreLast updated: 17 days ago