Talent.com
Senior Data Engineer
Senior Data EngineerMastercard • Pune, MH, India
No longer accepting applications
Senior Data Engineer

Senior Data Engineer

Mastercard • Pune, MH, India
8 hours ago
Job description

Our

Purpose

Mastercard

powers economies and empowers people in 200+ countries and

territories worldwide. Together with our customers, we’re helping

build a sustainable economy where everyone can prosper.

We support a wide range of digital payments choices, making

transactions secure, simple, smart and accessible. Our

technology and innovation, partnerships and networks combine to

deliver a unique set of products and services that help people,

businesses and governments realize their greatest

potential.

Title

and

Summary

Senior

Data Engineer

style="text-align : inherit">

Mastercard

Overview

Mastercard is the global technology company

behind the world’s fastest payments processing network. We are a

vehicle for commerce, a connection to financial systems for the

previously excluded, a technology innovation lab, and the home of

Priceless®. We ensure every employee can be a part of something

bigger and change lives. We believe as our company grows, so should

you. We believe in connecting everyone to endless, priceless

possibilities.

Your

Role :

  • Create and maintain optimal data

pipeline architecture.

  • Assemble large, complex data sets
  • that meet functional / non-functional business

    requirements.

  • Identify, design, and implement internal
  • process improvements : automating manual processes, optimizing data

    delivery, re-designing infrastructure for greater scalability,

    etc.

  • Build the infrastructure required for optimal
  • extraction, transformation, and loading of data from a wide variety

    of data sources using ETL processes and modern cloud

    technologies.

  • Take ownership or clarification of
  • requirements and solutions proposition before

    implementation.

  • Lead the building of scaled machine
  • learning production systems by designing pipelines and engineering

    infrastructure.

  • Facilitate the development and
  • deployment of offline ML models into production through the use of

    scalable tools and services to handle machine learning training and

    inference processes.

  • Identify, design, and implement
  • internal process improvements : automating manual processes,

    optimizing data delivery, re-designing infrastructure for greater

    scalability.

  • Create data tools for analytics and data
  • scientist team members that assist them in building and optimizing

    our product into an innovative industry leader.

  • Keep up
  • to date with latest open-source tools for data

    engineering.

  • Design, develop, implement, and debug large
  • and complex data platforms.

  • Analyze and improve
  • performance of existing platforms.

  • Implement new
  • technologies, policies and practices that can help increase

    resiliency, automation and improve platform health.

    Identifying technology gaps and help business build and deliver

    viable solutions.

  • Drive the evolution of Data &
  • Services products / platforms with an impact-focused on data science

    and engineering.

  • Participate in the development of data
  • and analytic infrastructure for product development.

    Continuously innovate and determine new approaches, tools,

    techniques & technologies to solve business problems and

    generate business insights & recommendations.

    Partner with roles across the organization including consultants,

    engineering, and sales to determine the highest priority problems

    to solve.

  • Evaluate trade-offs between many possible
  • analytics solutions to a problem, taking into account usability,

    technical feasibility, timelines, and differing stakeholder

    opinions to make a decision.

  • Break large solutions into
  • smaller, releasable milestones to collect data and feedback from

    product managers, clients, and other stakeholders.

    Ensure proper data governance policies are followed by implementing

    or validating Data Lineage, Quality checks, classification,

    etc.

  • Work with small, cross-functional teams to define
  • the vision, establish team culture and processes.

    Consistently focus on key drivers of organization value and

    prioritize operational activities accordingly.

  • Maintain
  • awareness of relevant technical and product trends through

    self-learning / study, training classes, and job

    shadowing.

    Ideal Candidate

    Qualifications :

    Experience leveraging

    open-source tools, predictive analytics, machine learning, Advanced

    Statistics, and other data techniques to perform basic

    analyses.

  • Demonstrated basic knowledge of statistical
  • analytical techniques, coding, and data engineering.

    Experience developing and configuring dashboards is a

    plus.

  • Demonstrated judgement when escalating issues to
  • the project team.

  • High proficiency in Python / Spark,
  • Hadoop platforms & tools (Hive, Impala, Airflow, NiFi),

    SQL.

  • Curiosity, creativity, and excitement for
  • technology and innovation.

  • Demonstrated quantitative and
  • problem-solving abilities.

  • Ability to multi-task and
  • strong attention to detail.

  • Motivation, flexibility,
  • self-direction, and desire to thrive on small project

    teams.

  • Expert proficiency in using Python / Scala,
  • Spark(tuning jobs), SQL, Hadoop platforms to build Big Data

    products & platforms.

  • Experience with data pipeline
  • and workflow management tools : NIFI, Airflow.

    Comfortable in developing shell scripts for automation.

    Proficient in standard software development, such as version

    control, testing, and deployment.

  • Experience with
  • visualization tools like tableau, looker.

  • At least 5
  • year leading collaborative work in complex engineering projects in

    an Agile setting e.g. Scrum.

  • Extensive data
  • warehousing / data lake development experience with strong data

    modeling and data integration experience.

  • Good SQL and
  • higher-level programming languages with solid knowledge of data

    mining, machine learning algorithms and tools.

  • Strong
  • hands-on experience in Analytics & Computer Science.

    Demonstrated basic knowledge of statistical analytical techniques,

    coding, and data engineering.

  • Experience in building and
  • deploying production-level data-driven applications and data

    processing workflows / pipelines and / or implementing machine learning

    systems at scale in Java, Scala, or Python and deliver analytics

    involving all phases like data ingestion, feature engineering,

    modeling, tuning, evaluating, monitoring, and

    presenting.

  • Outstanding communication and organizational
  • skills.

  • Strong English written and verbal communication
  • skills.

  • At least 5 years of relevant hands-on experience
  • as a Data Engineer in an individual contributor

    capacity.

  • Able to lead the implementation of machine
  • learning production systems.

  • Demonstrated ability,
  • through hands-on experience, to develop production machine learning

    pipelines.

  • At least a bachelor’s degree in computer
  • architecture, Computer Science, Electrical Engineering or

    equivalent experience. Postgraduate degree is an

    advantage.

    The following skills will be

    considered as a plus

  • Hands-on experience with cloud
  • computing and big data frameworks e.g. GCP, AWS, Azure, Flink,

    Elasticsearch, and Beam

  • Knowledge in MLOps frameworks
  • such as TensorFlow Extended, Kubeflow, or MLFlow

    Financial Institution or a Payments experience a plus

    Experience developing and configuring

    dashboards

    style="text-align : inherit">

    style="text-align : inherit">

    style="text-align : left">

    Corporate Security

    Responsibility

    style="text-align : left">

    All activities involving

    access to Mastercard assets, information, and networks comes with

    an inherent risk to the organization and, therefore, it is expected

    that every person working for, or on behalf of, Mastercard is

    responsible for information security and

    must :

    style="text-align : left">

    Abide by Mastercard’s security policies

    and practices;

    style="text-align : left">

    Ensure the confidentiality and integrity

    of the information being

    accessed;

    style="text-align : left">

    Report any suspected information

    security violation or breach,

    and

    style="text-align : left">

    Complete all periodic mandatory security

    trainings in accordance with Mastercard’s

    guidelines.

    style="text-align : inherit">

    style="text-align : inherit">

    style="text-align : inherit">

    style="text-align : inherit">

    Create a job alert for this search

    Senior Data Engineer • Pune, MH, India

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    CXC • Pune, IN
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Synechron • Pune, IN
    We have opprotunity for AWS Data Engineer.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative techn...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Syngenta Group • Pune, Maharashtra, India
    The Senior Data Engineer plays a pivotal role in driving the design development and optimization of robust scalable and high-performance data products and pipelines on Databricks (Spark / Delta Lake / ...Show more
    Last updated: 26 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Globant • Pune, IN
    At Globant, we are working to make the world a better place, one step at a time.We enhance business development and enterprise solutions to prepare them for a digital future.With a diverse and tale...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines,...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RiDiK (a Subsidiary of CLPS. Nasdaq : CLPS) • Pune, Maharashtra, India
    Role : Data Engineering Practice Leader.Data engineering Practice Leader.You'll shape our practice strategy, expand our offerings, and ensure successful delivery of complex data and AI solutions.Thi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EVERSANA • Pune, Maharashtra, India
    Senior Associate reporting to Associate Director - Engineering will play an essential role in designing developing and maintaining scalable data pipelines and data infrastructure.You will work clos...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Senior data engineer

    Senior data engineer

    Persistent Systems • Pune, Maharashtra, India
    We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong backgro...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear Corporation • Pune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
    Last updated: 24 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • Pune, Maharashtra, India
    Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more
    Last updated: 27 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Pune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerx • Pune, Maharashtra, India
    We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep exp...Show more
    Last updated: 17 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    vConstruct Private Limited • Pune, Maharashtra, India
    Construct, a Pune-based Construction Technology company is seeking a Senior Data Engineer for its Data Science and Analytics team, a close-knit group of analysts and engineers supporting all data a...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Zeza Technologies • Pune, IN
    Zeza is a vibrant team of programmers, data engineers, and data scientists passionate about innovation.We specialize in using data to drive business growth, solve complex challenges, and optimize o...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    VRIZE • Pune, IN
    Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Sonatype • Pune, IN
    Sonatype is the software supply chain security company.We provide the world’s best end-to-end software supply chain security solution, combining the only proactive protection against malicious open...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Databricks Data Engineer

    Senior Databricks Data Engineer

    Squash Apps • Pune, IN
    Squash Apps is a top-rated full-stack consulting company dedicated to building the next generation of scalable and robust web applications for visionary clients. We specialize in modern technologies...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Senior data engineer

    Senior data engineer

    VConstruct Private Limited • Pune, Maharashtra, India
    V Construct, a Pune-based Construction Technology company is seeking a Senior Data Engineer for its Data Science and Analytics team, a close-knit group of analysts and engineers supporting all data...Show more
    Last updated: 1 day ago • Promoted