Python Automation & Web Scraping Engineer (2 to 4 yrs)

Python Automation & Web Scraping Engineer (WFH)

Experience : 2–4 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

Strong hands-on experience in Python for automation and mid-scale web scraping projects.

Experience with Selenium, BeautifulSoup, Requests , and automation-driven scraping workflows.

Good understanding of HTML, CSS, DOM structures , and dynamic / JavaScript-rendered websites.

Experience in backend / API development using Flask or Django .

Ability to handle cookies, sessions, authentication flows, headers , and basic anti-bot mechanisms.

Strong skills in debugging, error handling, data cleaning, and optimization of scraping pipelines.

Key Responsibilities :

Develop, maintain, and optimize Python-based scraping scripts and automation pipelines .

Extract data from both static and dynamic websites, including sites requiring browser automation.

Manage pagination, login / authentication , and session-based scraping workflows.

Build and maintain REST APIs using Flask / Django to integrate data and automation services.

Implement data pipelines for cleaning, transforming, and storing outputs (CSV, Excel, JSON, DB).

Work with MySQL, PostgreSQL, MongoDB, Redis for structured and unstructured data storage.

Use Docker for containerizing automation modules and assist in basic cloud deployments.

Troubleshoot failures, implement retry / recovery logic, and ensure high accuracy of extracted data.

Maintain documentation, logging, and monitoring for all scraping and automation tasks.

Qualifications :

Solid programming experience in Python .

Hands-on experience with Selenium, BeautifulSoup, Requests (Playwright / Scrapy optional but good to have).

Understanding of HTTP, APIs, headers, cookies, sessions , and basic browser automation concepts.

Experience with backend frameworks like Flask or Django .

Familiarity with Docker and Git-based workflows.

Knowledge of relational and non-relational databases (MySQL / PostgreSQL / MongoDB / Redis).

Strong debugging, optimization, and troubleshooting abilities.