Web Scraping & Automation Engineer

Company Description

Foresiet is an AI-enabled SaaS-based Cybersecurity company that provides a comprehensive solution for Digital Risk Prevention. Leveraging the Cyber Digital Investigator platform, Foresiet proactively detects, monitors, and secures identity, data, and asset threats. Our unique combination of Human Intelligence (HUMINT) and Applied Research (HUMAN+TECHNOLOGY) protects individuals, enterprises, and the Federal Government.

Role Description

The specialist will be responsible for developing and maintaining automation processes.

• Develop and maintain sophisticated web scraping and automation scripts, troubleshooting issues,
• Understanding of CAPTCHA-solving approaches and working with proxy services, anti-blocking strategies : IP rotation, session management, fingerprinting / stealth, polite crawling (rate limiting, backoff), distributed workers & queueing.
• Social Media Scraping
• Integrate scalable captcha handling (human + automated fallbacks) and robust retry logic.
• Make the solution deployable (Docker + orchestration) and include monitoring, logging, and clear operational documentation.
• Creating and executing test cases, and ensuring quality assurance.
• Collaborate with the team to identify automation opportunities and implement solutions.
• Troubleshoot and debug technical issues related to scripts and data extraction.
• Stay updated with the latest trends in web technologies, anti-scraping measures, and AI tools.

Qualifications