Talent.com
This job offer is not available in your country.
Sr. Staff Data Engineer

Sr. Staff Data Engineer

The Nielsen CompanyGurgaon, Haryana, India
6 hours ago
Job description

At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future. ABOUT THIS JOB Platform engineers strike a balance between precision and disruption, between reliability and innovation. Nielsen is a tech company backed by over a century of forward momentum to show the world what’s next—and we couldn’t do it without our platform engineers. Nielsen Media is the market leader in content ratings across virtually all entertainment platforms including local and national TV, streaming, digital advertising, and more. In the role of Data Engineer on the Identity Team, you'll be responsible for developing the systems that estimate the audience consuming the content. This effort deals with massive data sets, demanding keen focus on both performance and design.

RESPONSIBILITIES

  • Use your knowledge of open source, cloud, and data technologies to architect better identity data products for our internal customers.
  • Perform architectural reviews for critical business products to ensure they are properly built for reliability, scalability, and cost optimization.
  • Design and implement low-latency large-scale data pipelines cleaning and transforming identity data.
  • Review and refine the fundamental Data Engineering and SRE practices in the Identity platform and help define a standard for use around Nielsen.
  • Mentor other platform team members to increase their technical and soft skills

A LITTLE BIT ABOUT YOU

  • You have a genuine passion for data engineering at scale and absolutely love learning new technologies. You don’t just want to blindly use platforms and libraries; instead you have a desire to tear them apart and figure out how they work inside. You love scaling and optimizing and seeing just how far or how fast your projects can go. You see all of the building blocks in the community as legos and want to use them to build innovative new solutions at a faster pace than ever.
  • You are also familiar with many of the following technologies and programming languages :
  • Apache Spark (spark-sql, graphframes)
  • Trino / Presto
  • Airflow
  • Python
  • Scala
  • Jupyter (Notebooks)
  • Postgres
  • AWS S3, EMR, IAM, KMS, EKS, RDS
  • QUALIFICATIONS

  • 5+ years of experience in a MLOps, Data Engineering, DBA or Database Developer role leading critical projects of high complexity.
  • Capable of proposing / evaluating data system architectures for high-scale projects.
  • In-depth knowledge and experience implementing core big data concepts and tools spanning source control, CI / CD, Infrastructure as Code, monitoring, alerting, logging.
  • Deep knowledge of Apache Spark is a must - spark-sql internals specifically is a significant plus.
  • Proficiency in AWS, with strong knowledge of S3, KMS and IAM.
  • Experience training and mentoring junior team members.
  • Experience with Apache Spark graphframes is a plus.
  • Create a job alert for this search

    Sr Data Engineer • Gurgaon, Haryana, India

    Related jobs
    • Promoted
    • New!
    Sr.Data And Analytics

    Sr.Data And Analytics

    Anicalls (Pty) LtdNoida, Uttar Pradesh, India
    Excellent Knowledge and expertise in 2 or more of the following areas : Statistical Modelling, Machine Learning, Operations Research, Neural Networks, Deep Learning. Hands-on Experience in coding on ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Data Engineer II

    Senior Data Engineer II

    AMEXGurugram, Haryana, India
    At American Express, our culture is built on a 175-year history of innovation, shared and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues.As pa...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AiGhaziabad, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 28 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CESDelhi, IN
    As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Sr. Azure Data Engineer

    Sr. Azure Data Engineer

    ALIQAN TechnologiesNew Delhi, Delhi, India
    We are urgently looking for a highly skilled and experienced.The ideal candidate must have a solid background in Azure Data Factory (ADF), Databricks, PySpark, and strong hands-on experience with m...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Staff Engineer

    Staff Engineer

    StrykerGurugram, Haryana, India
    You will implement complex systems based on defined application software architecture.You will translate design inputs to engineering specifications and produce component and sub-system level desig...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIDelhi, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    McCormickGurugram, Haryana, India
    At McCormick, we bring our passion for flavor to work each day.We encourage growth, respect everyone's contributions and do what's right for our business, our people, our communities and our planet...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLGhaziabad, IN
    We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 28 days ago
    • Promoted
    • New!
    Data Engineer III

    Data Engineer III

    RackspaceGurugram, Haryana, India
    Work Timings - Rotational Shifts (IST).The Data engineer is responsible for managing and operating upon .Tableau, Tableau bridge server, Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI....Show moreLast updated: 6 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeGhaziabad, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    S&P GlobalGurugram, Haryana, India
    Design, develop and maintain robust data pipelines to support data ingestion, transformation and storage.Write efficient SQL queries for data extraction, manipulation and analysis.Utilise Apache Sp...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    AdobeNoida, Uttar Pradesh, India
    Changing the world through digital experiences is what Adobe’s all about.We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital exper...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Generative AI Engineer (Databricks Data Lake)

    Senior Generative AI Engineer (Databricks Data Lake)

    AmpstekDelhi, IN
    Title : Senior Generative AI Engineer (Databricks Data Lake).We are seeking an experienced Senior Generative AI Engineer with a strong background in Databricks and data lake architectures.This indiv...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Talent WorxGurugram, Haryana, India
    The Data Engineer will have responsibility to use various methods to transform raw data into useful.The person must have familiarity with several programming languages and knowledge of.The primary ...Show moreLast updated: 6 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIDelhi, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer-Senior II

    Data Engineer-Senior II

    FedExGurugram, Haryana, India
    Responsible for developing, optimize, and maintaining business intelligence and data warehouse systems, ensuring secure, efficient data storage and retrieval, enabling self-service data exploration...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Rockwell AutomationNew Delhi, Delhi, India
    Rockwell Automation is a global technology leader focused on helping the world’s manufacturers be more productive, sustainable, and agile. With more than 28,000 employees who make the world better e...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgeDelhi, IN
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Warehouse Engineer (SSIS)

    Data Warehouse Engineer (SSIS)

    Tek ExpertsDelhi Division, Delhi, India
    We’re searching for a Data Warehouse Engineer with a proven track record of developing Business Intelligence solutions to drive key outcomes. The role is responsible for different layers of the data...Show moreLast updated: 6 hours ago