Python Web Scraping Engineer – Automation (3 To 10 Yrs)AIMLEAP • Gurgaon, Republic Of India, IN
Python Web Scraping Engineer – Automation (3 To 10 Yrs)
AIMLEAP • Gurgaon, Republic Of India, IN
1 day ago
Job descriptionDevelop and maintain high-scale automated scraping workflows for dynamic and protected websites. Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering. Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms. Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling. Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets. 3–10 years of experience in Python-based web scraping and automation . Strong experience in Selenium, Playwright, Puppeteer , and browser automation. Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy . Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies. Understanding of SQL / NoSQL databases for structured data storage. Experience working with AWS / GCP / Azure is a plus. Strong debugging, analytical, and problem-solving skills.
Python Web Scraping Engineer – Advanced Automation (WFH)
Experience : 3–10 Years
Location : Remote (Work from Home)
Mode of Engagement : Full-time
No of Positions : 8
Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field
Industry : IT / Software Services / Data & AI
Notice Period : Immediate Joiners Preferred
What We Are Looking For
- Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
- Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
- Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
- Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
- Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.
Responsibilities
Qualifications
Create a job alert for this search
Automation Engineer • Gurgaon, Republic Of India, IN
Related jobs
RankWatch, a dynamic and growing company in the software development industry with 51-200 employees, is seeking a talented Python Developer to join our team.
At RankWatch, we are committed to accoun...Show more
Design, develop, and maintain robust automation frameworks using Python and JavaScript.Create and execute automated test scripts for both front-end and back-end (API) testing.Develop and implement ...Show more
Backend Python Engineer - 17852
Turing • Gurugram, Haryana, India
We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models think, reason, and ...Show more
Last updated: 6 days ago • Promoted
Python Developer
TekXera • Gurgaon, Republic Of India, IN
Senior Python Engineer – Service Implementation.India | Pakistan | Nigeria | Kenya | Egypt | Ghana | Bangladesh | Turkey | Mexico.
Full-Time Contract (9 Months, Extendable).San Francisco–based AI re...Show more
Last updated: 1 day ago • Promoted
Fullstack Python Engineer (Cloud and AI)
Luxoft • Gurugram, Haryana, India
Noida / Hyderabad / Chennai / Gurgaon.Must have experience of maintaining & upgrading.NET based applications on Windows OS / Azure Cloud ,Experience with the MVC.
NET, SSIS, Web Services, Azure Web API, I...Show more
Last updated: 8 hours ago • Promoted • New!
Python (Airflow / DBT) Engineer
Luxoft • Gurugram, Haryana, India
This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure.
The goal is to enhance data access...Show more
Last updated: 8 hours ago • Promoted • New!
Manager Data Engineer (AWS, Python, UI and Web Engineer
Genpact • Gurgaon, Haryana, India
Ready to build the future with AI.At Genpact we dont just keep up with technologywe set the pace.AI and digital innovation are redefining industries and were leading the charge.Genpacts AI Gigafact...Show more
Last updated: 22 days ago • Promoted
Senior Python Automation Engineer - Playwright - (Immediate joiners only)
Innovya Technologies • gurgaon, haryana, in
Innovya Technologies is a dynamic and growing software consulting firm that drives business automation with cutting-edge solutions.
We help businesses quickly realize value from their technology and...Show more
Last updated: 13 hours ago • Promoted • New!
Full Stack Engineer (Python + JS / TS) - 17853
Turing • Gurgaon, Haryana, India
Role Overview : Turing is seeking experienced Full Stack Engineers to help build end-to-end AI-driven applications for US customers — spanning backend services, web frontends, and evaluation tooling...Show more
Last updated: 23 days ago • Promoted
Python Developer - 17852
Turing • Gurugram, Haryana, India
We’re looking for experienced Python developers to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models think, reason, and...Show more
Last updated: 30+ days ago • Promoted
Python Dev
RankWatch • Gurugram, Haryana, India
Quick Apply
Last updated: 30+ days ago
Python Developer
Recro • Gurugram, Haryana, India
Implement agentic workflows in Python using an agent framework.Experience with LangGraph, AutoGen, CrewAI, or equivalent is valuable.
Build reliable tool and function calling flows with planning, me...Show more
Last updated: 30+ days ago • Promoted
Python Automation Testing
Talent Worx • Gurugram, HR, IN
Quick Apply
Last updated: 30+ days ago
Web Scraping Engineer
noon • Gurgaon, Haryana, India
Job title : Web Scraping Engineer Location : Gurgaon About the Role We are looking for a Web Scraping Engineer with proven experience in building, maintaining, and scaling data extraction systems ...Show more
Last updated: 11 days ago • Promoted
Senior Python Automation Engineer - Playwright - (Immediate Joiners Only)
Innovya Technologies • Gurgaon, Republic Of India, IN
Innovya Technologies is a dynamic and growing software consulting firm that drives business automation with cutting-edge solutions.
We help businesses quickly realize value from their technology and...Show more
Last updated: 8 hours ago • Promoted • New!
Ai Engineer
ACL Digital • Gurgaon, Republic Of India, IN
Advanced working Scala ,SQL,Python / PySpark knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.Experience bu...Show more
Last updated: 30+ days ago • Promoted