Python Web Crawling Developer
We are seeking a highly skilled and motivated Python Web Crawling Developer with 5 to 10+ years of hands-on experience in web scraping and data extraction. The ideal candidate should have a solid background in Python-based scraping tools and libraries, and a proven track record of working on dynamic websites.
Responsibilities :
- Design, develop, and maintain scalable web crawlers and scrapers.
- Extract and process data from various static and dynamic websites.
- Work with tools and libraries like Scrapy, Requests, BeautifulSoup, and Selenium.
- Maintain and optimize existing full-stack web scraping applications.
- Write and maintain automation scripts for data gathering and processing.
- Ensure data quality, performance, and reliability of scraping solutions.
- Collaborate with cross-functional teams for integration and analytics use cases.
Requirements :
Strong proficiency in Python programming.In-depth experience with web scraping frameworks (Scrapy, Requests, BeautifulSoup, Selenium).Experience in handling dynamic content scraping (JavaScript-rendered pages).Working knowledge of SQL and database programming.Good analytical and problem-solving skills.Strong verbal and written communication skills.Experience in Python automation scripting.Good to Have :
Exposure to Natural Language Processing (NLP) tools like NLTK.Basic understanding or hands-on experience with Machine Learning.Experience with Python web frameworks like Django, Flask, or FastAPI.(ref : hirist.tech)