Data Engineer - (Spark, Scala, Python, Cassandra, Elasticsearch, AWS, Airflow, SQL)

At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future.

Responsibilities

• Work closely with team leads and backend developers to design and develop functional, robust pipelines to support internal and customer needs
• Write both unit and integration tests, and develop automation tools for daily tasks
• Develop high quality, well documented, and efficient code
• Manage and optimize scalable pipelines in the cloud
• Optimize internal and external applications for performance and scalability
• Develop automated tests to ensure business needs are met, and write unit, integration, or data quality tests
• Communicate regularly with stakeholders, project managers, quality assurance teams, and other developers regarding progress on long-term technology roadmap
• Recommend systems solutions by comparing advantages and disadvantages of custom development and purchased alternatives

Key Skills