Python Automation and Web Scraping Specialist

Company Description

Foresiet is an AI-enabled SaaS-based Cybersecurity company that provides a comprehensive solution for Digital Risk Prevention. Leveraging the Cyber Digital Investigator platform, Foresiet proactively detects, monitors, and secures identity, data, and asset threats. Our unique combination of Human Intelligence (HUMINT) and Applied Research (HUMAN+TECHNOLOGY) protects individuals, enterprises, and the Federal Government.

Role Description

The specialist will be responsible for developing and maintaining automation processes.

Develop and maintain sophisticated web scraping and automation scripts, troubleshooting issues,

Understanding of CAPTCHA-solving approaches and working with proxy services, anti-blocking strategies : IP rotation, session management, fingerprinting / stealth, polite crawling (rate limiting, backoff), distributed workers & queueing.

Social Media Scraping

Integrate scalable captcha handling (human + automated fallbacks) and robust retry logic.

Make the solution deployable (Docker + orchestration) and include monitoring, logging, and clear operational documentation.

Creating and executing test cases, and ensuring quality assurance.

Collaborate with the team to identify automation opportunities and implement solutions.

Troubleshoot and debug technical issues related to scripts and data extraction.

Stay updated with the latest trends in web technologies, anti-scraping measures, and AI tools.

Qualifications

Process Automation, Automation skills

Expert with web scraping libraries and tools such as Beautiful Soup and Scrapy

Anti Blocking Strategy- Captcha Bypass, IP rotation, session management, fingerprinting / stealth, polite crawling (rate limiting, backoff), distributed workers & queueing.

Social Media Scraping

Troubleshooting skills

Experience with creating and executing Test Cases

Quality Assurance skills

Proficiency in Python programming

Familiarity with web scraping libraries and tools such as Beautiful Soup and Scrapy

Excellent problem-solving and analytical skills

Ability to work independently and remotely