Talent.com
This job offer is not available in your country.
Sr. Staff Data Engineer

Sr. Staff Data Engineer

The Nielsen CompanyMumbai, Maharashtra, India
11 hours ago
Job description

At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future. ABOUT THIS JOB Platform engineers strike a balance between precision and disruption, between reliability and innovation. Nielsen is a tech company backed by over a century of forward momentum to show the world what’s next—and we couldn’t do it without our platform engineers. Nielsen Media is the market leader in content ratings across virtually all entertainment platforms including local and national TV, streaming, digital advertising, and more. In the role of Data Engineer on the Identity Team, you'll be responsible for developing the systems that estimate the audience consuming the content. This effort deals with massive data sets, demanding keen focus on both performance and design.

RESPONSIBILITIES

  • Use your knowledge of open source, cloud, and data technologies to architect better identity data products for our internal customers.
  • Perform architectural reviews for critical business products to ensure they are properly built for reliability, scalability, and cost optimization.
  • Design and implement low-latency large-scale data pipelines cleaning and transforming identity data.
  • Review and refine the fundamental Data Engineering and SRE practices in the Identity platform and help define a standard for use around Nielsen.
  • Mentor other platform team members to increase their technical and soft skills

A LITTLE BIT ABOUT YOU

  • You have a genuine passion for data engineering at scale and absolutely love learning new technologies. You don’t just want to blindly use platforms and libraries; instead you have a desire to tear them apart and figure out how they work inside. You love scaling and optimizing and seeing just how far or how fast your projects can go. You see all of the building blocks in the community as legos and want to use them to build innovative new solutions at a faster pace than ever.
  • You are also familiar with many of the following technologies and programming languages :
  • Apache Spark (spark-sql, graphframes)
  • Trino / Presto
  • Airflow
  • Python
  • Scala
  • Jupyter (Notebooks)
  • Postgres
  • AWS S3, EMR, IAM, KMS, EKS, RDS
  • QUALIFICATIONS

  • 5+ years of experience in a MLOps, Data Engineering, DBA or Database Developer role leading critical projects of high complexity.
  • Capable of proposing / evaluating data system architectures for high-scale projects.
  • In-depth knowledge and experience implementing core big data concepts and tools spanning source control, CI / CD, Infrastructure as Code, monitoring, alerting, logging.
  • Deep knowledge of Apache Spark is a must - spark-sql internals specifically is a significant plus.
  • Proficiency in AWS, with strong knowledge of S3, KMS and IAM.
  • Experience training and mentoring junior team members.
  • Experience with Apache Spark graphframes is a plus.
  • Create a job alert for this search

    Sr Data Engineer • Mumbai, Maharashtra, India

    Related jobs
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    MEDPACENavi Mumbai, Maharashtra, India
    Medpace is a full-service clinical contract research organization (CRO).We provide Phase I-IV clinical development services to the biotechnology, pharmaceutical and medical device industries.Our mi...Show moreLast updated: 11 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgeKalyan-Dombivli, IN
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Sr.Data software Engineer

    Sr.Data software Engineer

    Anicalls (Pty) LtdMumbai, Maharashtra, India
    Proactively partner with IT and research staff to maintain and renovate, as needed, the metadata across the data warehouse, research, reporting, and business intelligence environments to maintain c...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    AunalyticsMumbai, Maharashtra, India
    As a Senior Data Engineer (multiple openings), you will work independently to design strategies for enterprise database systems and set standards for operations, programming, and security.Critical ...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    SiaMumbai, Maharashtra, India
    We are looking for a talented and motivated Data Engineer with strong experience in PySpark and Python to design, build, and maintain scalable data pipelines and infrastructure.The successful candi...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior Data Engineer_H

    Senior Data Engineer_H

    The Nielsen CompanyMumbai, Maharashtra, India
    We are seeking a Sr Data Engineer to join the Campaign Analytics team.In Campaign Analytics, we develop products that measure, analyze, and report on Advertisement Effectiveness.As a Senior Data En...Show moreLast updated: 11 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainKalyan-Dombivli, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIMumbai, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 21 days ago
    • Promoted
    • New!
    Sr. Data Engineer

    Sr. Data Engineer

    MorningstarMumbai, Maharashtra, India
    As a member of the Enterprise Data Platform team and Enterprise Technology organization within Technology & Engineering at PitchBook, you will be part of a team of big thinkers, innovators, and pro...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    AWS Data Engineer - Sr Consultant

    AWS Data Engineer - Sr Consultant

    Talent WorxMumbai, Maharashtra, India
    We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background i...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Multi RecruitMumbai, Maharashtra, India
    Design, develop, and maintain data architecture solutions.Organize, transform, and load data from various sourcesinto our data warehouse. Develop and maintain automated data pipelines and ETLprocess...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Sr Data Engineer

    Sr Data Engineer

    White ForceNavi Mumbai, Maharashtra, India
    Minimum 5+ years of experience as Data Engineers.Strong Proficiency with Open-Source Technologies like HDFS, Hive, Kafka Spark. Must have strong experience to solve any ongoing issues with operating...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    The Nielsen CompanyMumbai, Maharashtra, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    Anicalls (Pty) LtdMumbai, Maharashtra, India
    Worked collaboratively with cross-functional teams and stakeholders to achieve an organizational goal.Worked in an agile environment and are comfortable running an agile process for the data and an...Show moreLast updated: 11 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIThane, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 11 days ago
    • Promoted
    Senior Generative AI Engineer (Databricks Data Lake)

    Senior Generative AI Engineer (Databricks Data Lake)

    AmpstekKalyan-Dombivli, IN
    Title : Senior Generative AI Engineer (Databricks Data Lake).We are seeking an experienced Senior Generative AI Engineer with a strong background in Databricks and data lake architectures.This indiv...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Sr Data Engineer, Analytics_Mumbai

    Sr Data Engineer, Analytics_Mumbai

    The Nielsen CompanyMumbai, Maharashtra, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Data Engineer-Senior II

    Data Engineer-Senior II

    FedExMumbai, Maharashtra, India
    Responsible for developing, optimize, and maintaining business intelligence and data warehouse systems, ensuring secure, efficient data storage and retrieval, enabling self-service data exploration...Show moreLast updated: 11 hours ago