Responsibilities
- Own data quality for existing data pipelines and develop an end-to-end quality framework covering outages, freshness, accuracy, and issue reporting.
- Define best practices for quality development, engineering, and coding as part of a world-class engineering team at PepsiCo.
- Collaborate with the product team on core technology platforms including Direct Commerce, Supply Chain, Marketing Automation, Mobile, and Data.
- Participate in architecture discussions and decisions to continuously improve and expand platforms.
- Lead framework development with other engineers, validate requirements, assess capabilities, and decompose manual quality and engineering tasks.
- Deliver high-quality data pipelines and tools through analysis, peer reviews, test automation, and collaboration with QA engineers.
- Develop software in short iterations partnering with teams like MonteCarlo, Great Expectations, and Sentry to quickly add business value.
- Introduce new tools and practices to improve data and code quality by researching and sourcing third-party tools or developing in-house solutions to enhance workflows for data engineers and operations teams.
Skills Required
Python, Sql, Airflow, Aws, Azure