Software Engineer

Software Engineer - Content Parsing

The Opportunity

We're looking for a talented and detail-oriented Software Engineer - Content Parsing to join our dynamic team. In this role, you'll be crucial in extracting, categorizing, and structuring vast amounts of content from various web sources. You'll leverage your expertise in Python and related parsing technologies to build robust, scalable, and highly accurate parsing solutions. This position requires a strong focus on data quality, comprehensive testing, and the ability to implement effective alerting and notification systems.

Responsibilities :

• Design, develop, and maintain robust and scalable HTML parsing solutions to extract diverse web content.
• Implement advanced content categorization logic to accurately classify and tag extracted data based on predefined schemas and business rules, incorporating AI / ML techniques where applicable.
• Develop and integrate alerting and notification systems to monitor parsing performance, identify anomalies, and report on data quality issues.
• Write comprehensive unit, integration, and end-to-end test cases to ensure the accuracy, reliability, and robustness of parsing logic, covering all boundary conditions and edge cases.
• Optimize parsing performance and efficiency to handle large volumes of data.
• Troubleshoot and resolve parsing issues, adapting to changes in website structures and content formats.
• Contribute to the continuous improvement of our parsing infrastructure and methodologies, including the research and adoption of new AI-driven parsing techniques.
• Manage and deploy parsing solutions in a Linux environment.
• Collaborate with DevOps engineers to improve the scaling, deployment, and operational efficiency of parsing solutions.
• This role requires occasional weekend work as content changes are typically deployed on weekends, necessitating monitoring and immediate adjustments.

Qualifications :