Talent.com
Data Pipeline Manager

Data Pipeline Manager

MastercardPune, Republic Of India, IN
21 days ago
Job description

Title and Summary

Manager, Data Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow

Who is Mastercard?

Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.

Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.

Overview :

The Mastercard Account Level Management (ALM) platform empowers real-time card level decisioning. As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend.

Role :

  • Managing multiple scrum teams of Software developers and testers to develop quality software solutions in a timely and cost-effective manner.
  • Successfully lead definition, development and delivery of major cross-department initiatives with broad scope and long-term business implications.
  • Provide technical leadership and direction to software development teams in the development of services and capabilities, Understand, implement and enforce Software development standards and engineering principles in the Big Data space.
  • Work closely with product and architecture teams on product definition, technical design, and overall execution for the team.
  • Ensure the project or effort is adequately staffed;
  • trained and managed. Ensure personnel have appropriate skills and behaviors;
  • and effectively communicate performance results;

as necessary, managing each effort within approved manpower and budget guidelines

  • Technically manage and drive deliveries from scrum teams that will be responsible implementing, documenting, testing, maintaining and supporting applications in adherence with industry best practices specially in Big Data space.
  • Developing high quality, secure, scalable solutions based on technical requirements specifications and design artifacts within expected time and budget.
  • Work across on-premises and cloud environments (AWS, Azure, Databricks).
  • Design & development of high quality data driven applications and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.
  • Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge.
  • Expertise to guide team in using SDLC tools such Git-based version control systems, CI / CD pipelines using Jenkins, Checkmarx, test automation tools etc
  • Proficient in working within an Agile / Scrum framework, including creating user stories with well-defined acceptance criteria, participating in sprint planning and reviews
  • Good to have experience in developing enterprise solutions (standalone applications, services & SDK) using J2EE, JDBC (SQL & NoSQL) related technologies like Spring & Spring framework, micro services on Cloud.
  • Integrating content feeds via API, JSON, XML, and RSS from both internal and external sources.
  • supporting internal and external users of the applications / systems, performing production incident management and participating in on-call escalation pager support rotation.
  • Documenting application components for support and training materials for MasterCard Quality Assurance and Quality Control processes.
  • About You :

  • Hands-on technical leader who brings considerable experience doing application development and managing teams by using a broad range of technologies and dives deep into everything team does.
  • Demonstrate leadership, ethics and values to generate high trust with team, peers, and management.
  • Must be high-energy, detail-oriented and proactive with the ability to function under pressure in an independent environment.
  • Must provide the necessary skills to have a high degree of initiative and self-motivation with a willingness and ability to learn and take on challenging opportunities.
  • Strong communication skills – both verbal and written – with strong relationship building, collaborative skills and organizational skills.
  • Must be obsessed with results, and effectively communicate objectives and how success will be measured to the team and other stakeholders.
  • Have strong decision-making skills, lead retrospection and continually improve as a result.
  • Understands how to guide an engineer’s career including performance evaluation, coaching, and motivation.
  • Create a job alert for this search

    Manager Data Pipeline • Pune, Republic Of India, IN

    Related jobs
    • Promoted
    Cloud Data Pipeline Engineer

    Cloud Data Pipeline Engineer

    InfarsightPune, Republic Of India, IN
    At Infarsight, we simplify complex operations across Finance, HR, Operations, and Supply Chain using platforms like Task Sight, Trip Sight, and Fleet Sight. Our engineering teams build scalable soft...Show moreLast updated: 22 days ago
    • Promoted
    Principal Data Pipeline Engineer

    Principal Data Pipeline Engineer

    SAIVA AIRepublic Of India, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Pipeline Engineer

    Principal Data Pipeline Engineer

    CoditasPune, Republic Of India, IN
    Understand Business requirements and implement scalable solutions.Translate complex technical and functional requirements into detailed designs. Develop a highly scalable, reliable, and high-perform...Show moreLast updated: 15 days ago
    • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Enterprise Minds, IncPune, Republic Of India, IN
    As a data engineer, you will be responsible for delivering data intelligence solutions to our customers all around the globe, based on an innovative product, which provides insights into the perfor...Show moreLast updated: 14 days ago
    • Promoted
    • New!
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    SutherlandRepublic Of India, IN
    Location : Bangalore | Hyderabad | Chennai | Mumbai.If interested please reach out to me with your updated resume @priti. We’re transforming how we work by harnessing the power of AI, data, and digit...Show moreLast updated: 18 hours ago
    • Promoted
    • New!
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Atyeti IncRepublic Of India, IN
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.SQL and cloud-native devel...Show moreLast updated: 18 hours ago
    • Promoted
    • New!
    Senior Data Pipeline Lead

    Senior Data Pipeline Lead

    thinkbridgePune, Republic Of India, IN
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 18 hours ago
    • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    JMAN GroupChennai, Republic Of India, IN
    JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial...Show moreLast updated: 1 day ago
    • Promoted
    Data Pipeline Specialist

    Data Pipeline Specialist

    TEKsystemsRepublic Of India, IN
    The position is open with DaaS Core Data Assets Development and Support team, they focus on the serving external customers / clients and the position is open as part of new hiring projection for thei...Show moreLast updated: 9 days ago
    • Promoted
    Principal Data Pipeline Engineer

    Principal Data Pipeline Engineer

    Newscape ConsultingPune, Republic Of India, IN
    The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data ecos...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Persistent SystemsPune, Republic Of India, IN
    We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong backgro...Show moreLast updated: 18 days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsNagpur, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladenagpur, maharashtra, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    AIMLEAPNagpur, IN
    Senior Data Engineer – ETL & Pipeline Development.Remote (Work from Home) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.Pandas, Airflow, o...Show moreLast updated: 21 hours ago
    • Promoted
    Data Pipeline Specialist

    Data Pipeline Specialist

    StraiveRepublic Of India, IN
    Data Engineer will be responsible for designing, developing, and maintaining data pipelines and architectures that support the organization's analytics and reporting needs.The ideal candidate will ...Show moreLast updated: 20 days ago
    • Promoted
    Principal Data Pipeline Engineer

    Principal Data Pipeline Engineer

    Sonata SoftwareRepublic Of India, IN
    The Senior Software Engineer supports functions which require automation / systems development, including initial development and ongoing support of the suite of applications that would help manage l...Show moreLast updated: 21 days ago
    • Promoted
    Sr ETL Data Engineer -HL7

    Sr ETL Data Engineer -HL7

    BigRionagpur, maharashtra, in
    Job Title : Sr ETL Data Engineer -HL7.Location : Remote – India (UK Shift).BigRio is a remote-based, technology consulting firm headquartered in Boston, MA. We specialize in delivering advanced softwa...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Sr Manager Data Sciences

    Sr Manager Data Sciences

    Live ConnectionsNagpur, IN
    Role - Sr Manager, Data Scientist.Required Notice Period - Immediate Joiners or Serving Notice or official 30 days.Hands-on experience in AI & GenerativeAI. Should be working as a Data Scientist.To ...Show moreLast updated: 19 hours ago