Talent.com
This job offer is not available in your country.
Sr. Staff Data Engineer

Sr. Staff Data Engineer

The Nielsen CompanyBangalore, India
30+ days ago
Job description

At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future. ABOUT THIS JOB Platform engineers strike a balance between precision and disruption, between reliability and innovation. Nielsen is a tech company backed by over a century of forward momentum to show the world what’s next—and we couldn’t do it without our platform engineers. Nielsen Media is the market leader in content ratings across virtually all entertainment platforms including local and national TV, streaming, digital advertising, and more. In the role of Data Engineer on the Identity Team, you'll be responsible for developing the systems that estimate the audience consuming the content. This effort deals with massive data sets, demanding keen focus on both performance and design.

RESPONSIBILITIES

  • Use your knowledge of open source, cloud, and data technologies to architect better identity data products for our internal customers.
  • Perform architectural reviews for critical business products to ensure they are properly built for reliability, scalability, and cost optimization.
  • Design and implement low-latency large-scale data pipelines cleaning and transforming identity data.
  • Review and refine the fundamental Data Engineering and SRE practices in the Identity platform and help define a standard for use around Nielsen.
  • Mentor other platform team members to increase their technical and soft skills

A LITTLE BIT ABOUT YOU

  • You have a genuine passion for data engineering at scale and absolutely love learning new technologies. You don’t just want to blindly use platforms and libraries; instead you have a desire to tear them apart and figure out how they work inside. You love scaling and optimizing and seeing just how far or how fast your projects can go. You see all of the building blocks in the community as legos and want to use them to build innovative new solutions at a faster pace than ever.
  • You are also familiar with many of the following technologies and programming languages :
  • Apache Spark (spark-sql, graphframes)
  • Trino / Presto
  • Airflow
  • Python
  • Scala
  • Jupyter (Notebooks)
  • Postgres
  • AWS S3, EMR, IAM, KMS, EKS, RDS
  • QUALIFICATIONS

  • 5+ years of experience in a MLOps, Data Engineering, DBA or Database Developer role leading critical projects of high complexity.
  • Capable of proposing / evaluating data system architectures for high-scale projects.
  • In-depth knowledge and experience implementing core big data concepts and tools spanning source control, CI / CD, Infrastructure as Code, monitoring, alerting, logging.
  • Deep knowledge of Apache Spark is a must - spark-sql internals specifically is a significant plus.
  • Proficiency in AWS, with strong knowledge of S3, KMS and IAM.
  • Experience training and mentoring junior team members.
  • Experience with Apache Spark graphframes is a plus.
  • Create a job alert for this search

    Sr Data Engineer • Bangalore, India

    Related jobs
    Staff Data Engineer

    Staff Data Engineer

    Leading-Biotechnology-CompanyBengaluru, India
    Illumina is a leading developer, manufacturer, and marketer of life science tools and integrated systems dedicated to making genomics useful for all. Illuminas integrated Indian global hub in Bengal...Show moreLast updated: 2 days ago
    Sr Data Engineer

    Sr Data Engineer

    Reveal Health TechBengaluru, KA, IN
    Quick Apply
    Thank you for considering the Senior Data Engineer position at Reveal Health Tech.We are an early-stage IT startup based in the US and India, focused on leveraging technology to deliver transformat...Show moreLast updated: 29 days ago
    Sr Staff Engineer

    Sr Staff Engineer

    renesas electronicsINDIA
    Renesas is one of the top global semiconductor companies in the world.We strive to develop a safer, healthier, greener, and smarter world, and our goal is to make every endpoint intelligent by offe...Show moreLast updated: 30+ days ago
    Sr Staff IT Software Engineer

    Sr Staff IT Software Engineer

    Palo Alto NetworksBengaluru, Karnataka, India
    At Palo Alto Networks® everything starts and ends with our mission : .Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and m...Show moreLast updated: 2 days ago
    • Promoted
    PowerSchool - Staff Data Engineer

    PowerSchool - Staff Data Engineer

    PowerSchoolBangalore
    Overview : This position, under the general direction of the Director or Vice President, Software Engineering, will be responsible for technical and development suppo...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Data Engineer

    Staff Data Engineer

    BlackLine IndiaBengaluru, Karnataka, India
    It's fun to work in a company where people truly believe in what they're doing!.At BlackLine, we're committed to bringing passion and customer focus to the business of enterprise applications.Since...Show moreLast updated: 7 days ago
    Sr. Data Engineer - Analytics

    Sr. Data Engineer - Analytics

    Synaxis Informatic Tech SolutionsBengaluru, Karnataka, India
    We're looking for a talented and experienced Data Engineer - Analytics to join our client's team.This role will see you designing, building, and maintaining robust data pipelines and infrastructure...Show moreLast updated: 14 days ago
    Staff Data Engineer

    Staff Data Engineer

    HypersonixBangalore, Karnataka, IN
    Quick Apply
    AI, ML and advanced decision capabilities to drive real-time business insights.We are looking for talented and driven Data Engineers at various levels to work with customers to build the data wareh...Show moreLast updated: 30+ days ago
    Staff Data Engineer

    Staff Data Engineer

    VisaBangalore, Karnataka, India
    To ensure that Visas payment technology is truly available to everyone everywhere requires the success of our key bank or merchant partners and internal business units.The Internal AI & Data Sc...Show moreLast updated: 30+ days ago
    • New!
    Sr. Data Engineer

    Sr. Data Engineer

    KAWEN MANPOWERBangalore North, KA, in
    Quick Apply
    This role is part of our growing data science team, where you will drive the setup and implementation of robust data management processes and contribute to various client projects.Design, build, an...Show moreLast updated: 5 hours ago
    Sr. Data Engineer

    Sr. Data Engineer

    RecroBengaluru, Karnataka, India
    Lifesight Is empowering decisions with Advanced Data Intelligence.Lifesight is a fast-growing SaaS company focused on helping businesses leverage data. AI to improve customer acquisition and retenti...Show moreLast updated: 14 days ago
    • Promoted
    Staff Engineer - Data Science

    Staff Engineer - Data Science

    XHire.OneBangalore
    Requirements : - Experience : 5+ Years - Proven experience in a data science leadership role, with a strong track record of delivering successful projects....Show moreLast updated: 30+ days ago
    Sr Staff Application Engineer

    Sr Staff Application Engineer

    Renesas ElectronicsBengaluru, Karnataka, India
    The automotive AI Systems group within the High Performance Computing (HPC) department is seeking a (Junior) Machine Learning Engineer to support embedded system solutions and technical customer su...Show moreLast updated: 16 days ago
    • Promoted
    Staff / Principal Data Engineer

    Staff / Principal Data Engineer

    Credit Saison IndiaBengaluru, Karnataka, India
    Established in 2019, CS India is one of the country’s fastest growing Non-Bank Financial Company (NBFC) lenders, with verticals in wholesale, direct lending and tech-enabled partnerships with Non-B...Show moreLast updated: 17 days ago
    • New!
    Sr. Staff Engineer, Data Security

    Sr. Staff Engineer, Data Security

    NetskopeBengaluru, Karnataka, India
    Today, there's more data and users outside the enterprise than inside, causing the network perimeter as we know it to dissolve. We realized a new perimeter was needed, one that is built in the cloud...Show moreLast updated: 18 hours ago
    • Promoted
    Staff Data Engineer

    Staff Data Engineer

    Anzy Global.Bangalore
    We're looking for a Data Platform Engineer with deep systems engineering expertise and a passion for building reusable infrastructure. You'll help architect and deliver the internal framew...Show moreLast updated: 25 days ago
    Sr. Data Engineer

    Sr. Data Engineer

    Epergne SolutionsBengaluru, Karnataka, India
    Quick Apply
    Epergne Solutions is looking for.Financial Services domain, preferably in risk management (AML / Fraud transformation) function of a bank. Detailed JD •(Roles and Responsibilities).Proficiency in quer...Show moreLast updated: 30+ days ago
    Sr. Staff Data Engineer

    Sr. Staff Data Engineer

    NIELSENINDIA
    At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results.Our talented,...Show moreLast updated: 30+ days ago