Key Responsibilities :
- Data Ingestion : Develop and maintain data pipelines to ingest product feeds
- from multiple sources in various formats, including CSV, XML, and JSON.
- Data Processing and Transformation : Clean, validate, and transform incoming
- data feeds to ensure they conform to our internal data standards. This includes
- handling malformed data and transforming all data into JSON format.
- Automation and Optimization : Automate feed processing tasks, ensuring
- efficiency, reliability, and scalability of the data ingestion pipeline.
- API Integration : Implement and manage API integrations to upload processed
- data to our feed server and ensure smooth data flow across systems.
- Collaboration : Work closely with data engineers, product managers, and
- other stakeholders to understand data requirements and ensure the feed
- processing pipeline meets business needs.
- Monitoring and Troubleshooting : Monitor feed processing workflows, identify
- bottlenecks, troubleshoot issues, and optimize performance.
Key Requirements :
Strong proficiency in Python programming.Experience with data parsing and processing in formats such as CSV, XML,and JSON.Knowledge of data cleaning, validation, and transformation techniques.Hands-on experience with API integration and handling RESTful services.Familiarity with data pipelines, ETL processes, and automation tools.Solid understanding of error handling and data quality assurance bestpractices.Experience with e-commerce data feeds is a plus.Strong problem-solving skills and attention to detail.Skills Required
Optimization, Data Processing, Api Integration, Automation