Talent.com
Senior Data Engineer( DWH)

Senior Data Engineer( DWH)

MastercardPune, Maharashtra, India
15 days ago
Job description

Title and Summary

Senior Data Engineer

Job Description Summary

Senior Data Engineer (DW)

Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.

Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.

Overview

Mastercard is looking for a Senior Software Engineer to join the Account Level Management(ALM) team in our Pune office that’s focused on building ALM Services with Data warehouse skills. The Mastercard Account Level Management platform empowers real-time card level decisioning. As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend.

  • Role

o Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.

o Leverage technologies and solutions to innovate with increasingly large data sets.

o Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration.

o Understand, implement and enforce Software development standards and engineering principles in the Big Data space.

o Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.

o Perform assigned tasks and production incident independently.

  • Skill Requirements :
  • MUST Technical
  • 5-9 years of experience in Data Warehouse / Data Lake / Lake House related projects in product or service-based organization
  • Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment handling petabyte scale data.
  • Solid Experience of building complex data pipelines through Spark with Scala / Python / Java on Hadoop or Object storage
  • Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge.
  • Proficient in working within an Agile / Scrum framework, including creating user stories with well-defined acceptance criteria, participating in sprint planning and reviews
  • Write and maintain Unix shell scripts, Oracle SQL, PL / SQL, and perform SQL tuning.
  • Optimize and troubleshoot Spark applications for performance, scalability, and fault tolerance
  • Use Git-based version control systems and CI / CD pipelines (e.g., Jenkins).
  • Implement and manage HIVE external tables, partitions, and various file formats.
  • Work across on-premises and cloud environments (AWS, Azure, Databricks).
  • Strong experience with Hadoop ecosystem and Cloudera Data Platform (CDP).
  • Optional Technical
  • Experience of building Nifi pipelines (Preferred)
  • Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
  • Strong communication skills - both verbal and written
  • Ability to multi-task across multiple projects, interface with external / internal resources
  • Proactive, detail-oriented and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results
  • Willingness to quickly learn and implement new technologies, participate POC to explore best solution for the problem statement
  • Experience working diverse and geographically distributed project teams
  • Education :
  • Bachelor’s degree in information systems, Information Technology, Computer Science or Engineering or equivalent work experience.
  • Create a job alert for this search

    Senior Data Engineer • Pune, Maharashtra, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MSBC GroupPune, Maharashtra, India
    As a Data Engineer, your primary role is to create and maintain high-performance data pipelines, warehouses, and cloud-based systems. This includes creating efficient batch and streaming pipelines, ...Show moreLast updated: 15 days ago
    • Promoted
    5447 | Senior Data Engineer

    5447 | Senior Data Engineer

    EXLPune, Maharashtra, India
    Title : Senior Data Engineer Experience : 6+ Years We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, ...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadypune, maharashtra, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Futran SolutionsPune, Maharashtra, India
    Job Title : Senior Data Engineer / Data Engineer Lead.We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms.The ideal candida...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (ADB + Snowflake)

    Senior Data Engineer (ADB + Snowflake)

    Persistent SystemsPune, Maharashtra, India
    We are looking for a highly skilled and innovative Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and Snowflake, along with hands-on experience integrating AI tools such a...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfarsightPune, Maharashtra, India
    Infarsight helps enterprises scale strategic business transformation through automation, AI, and product innovation.We streamline operations with platforms like Task Sight, Trip Sight, and Fleet Si...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RiDiK (a Subsidiary of CLPS. Nasdaq : CLPS)Pune, Maharashtra, India
    This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to the success of a growing company. If you’re someone who takes initiative, val...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Aim Plus Staffing SolutionsPune
    Description : Position : Senior Data Engineer (AWS / GCP) Work Location : Pune <...Show moreLast updated: 13 days ago
    • Promoted
    • New!
    ▷ High Salary : Senior Data Engineer

    ▷ High Salary : Senior Data Engineer

    InfarsightPune, Maharashtra, India
    About : Infarsight helps enterprises scale strategic business transformation through automation, AI, and product innovation. We streamline operations with platforms like Task Sight, Trip Sight, and ...Show moreLast updated: 5 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIPune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Helpshift, a Keywords TechnologyPune, Maharashtra, India
    We are on a mission to rid the world of bad customer service by “mobilizing” the way help is delivered.Today’s consumers want an always-available customer service experience that leaves them feelin...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent SystemsPune, Maharashtra, India
    We are looking for an experienced Azure Databricks and Snowflake Data Engineer to lead and execute complex user migrations from legacy systems to modern cloud-based solutions.This role involves col...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Persistent SystemsPune, Maharashtra, India
    We are seeking a Senior Platform Engineer to architect, build, and manage enterprise-scale data platforms that power advanced analytics and AI initiatives. This role blends cloud engineering, DevOps...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CoditasPune, Maharashtra, India
    Understand Business requirements and implement scalable solutions.Translate complex technical and functional requirements into detailed designs. Develop a highly scalable, reliable, and high-perform...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh Incpune, India
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 8 days ago
    • Promoted
    15h Left : Senior Data Engineer( DWH)

    15h Left : Senior Data Engineer( DWH)

    MastercardPune, Maharashtra, India
    Title and Summary Senior Data Engineer Job Description Summary Senior Data Engineer (DW) Mastercard is a global technology company in the payments industry. Our mission is to connect and power a...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer( DWH)

    Senior Data Engineer( DWH)

    MastercardPune, Maharashtra, India
    Mastercard is a global technology company in the payments industry.Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, ...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIPune, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 24 days ago