Python Web Scraping Engineer – Automation (3 To 10 Yrs)AIMLEAP • Gurgaon, Republic Of India, IN
Python Web Scraping Engineer – Automation (3 To 10 Yrs)
AIMLEAP • Gurgaon, Republic Of India, IN
11 hours ago
Job descriptionDevelop and maintain high-scale automated scraping workflows for dynamic and protected websites. Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering. Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms. Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling. Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets. 3–10 years of experience in Python-based web scraping and automation . Strong experience in Selenium, Playwright, Puppeteer , and browser automation. Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy . Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies. Understanding of SQL / NoSQL databases for structured data storage. Experience working with AWS / GCP / Azure is a plus. Strong debugging, analytical, and problem-solving skills.
Python Web Scraping Engineer – Advanced Automation (WFH)
Experience : 3–10 Years
Location : Remote (Work from Home)
Mode of Engagement : Full-time
No of Positions : 8
Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field
Industry : IT / Software Services / Data & AI
Notice Period : Immediate Joiners Preferred
What We Are Looking For
- Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
- Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
- Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
- Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
- Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.
Responsibilities
Qualifications
Create a job alert for this search
Automation Engineer • Gurgaon, Republic Of India, IN
Related jobs
Python Web Scraping Engineer – Automation (3 to 10 yrs)
AIMLEAP • gurugram, uttar pradesh, in
Python Web Scraping Engineer – Advanced Automation (WFH).Bachelor’s degree in Computer Science, IT, or related field .IT / Software Services / Data & AI .
Strong hands-on experience handling.Seleniu...Show more
Last updated: 16 hours ago • Promoted • New!
Senior Developer - Python / React.js
C G Vak Softwares & Exports Limited • Gurugram
Description : Role & Responsibilities : - Design and deve...Show more
Last updated: 9 days ago • Promoted
Axtria - Lead Full Stack Developer - Python / React.js
Axtria India Pvt Ltd • Gurugram
Designation : Senior Engineer | Lead Engineer Location : Bengaluru, Gurugram , Noida , Pune , Hyderabad Job Purpose : ...Show more
Last updated: 30+ days ago • Promoted
Publicis Sapient - Lead Product Engineer - Python Technologies
TLG INDIA PRIVATE LIMITED • Gurugram
Description : As a Lead product Engineer (Sr.Manager), you will be responsible for driving the end-to-end product engineering lifecycle, from ideat...Show more
Last updated: 30+ days ago • Promoted
Backend Python Engineer - 17852
Turing • Gurugram, Haryana, India
We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models think, reason, and ...Show more
Last updated: 6 days ago • Promoted
AI Developer - Python / C#
Skyleaf • Gurugram
Description : Hiring : AI Developer Experience : 3-7 years Location : Gurugram Work Mode : WFO (UK Shift) Show more
Last updated: 11 days ago • Promoted
Web Scraping Engineer
noon • Gurugram, Haryana, India
Job title : Web Scraping Engineer.The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.Develop and...Show more
Last updated: 7 days ago • Promoted
Full Stack Engineer - Python / React.js
Naukari Wale • Gurugram
Description : We are seeking a highly skilled and passionate Full-Stack Developer who thrives in fast-paced, ambiguous environments and enjoys building scalable produ...Show more
Last updated: 30+ days ago • Promoted
Python Developer - 17852
Turing • Gurgaon, Haryana, India
Role Overview : We’re looking for experienced Python developers to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models thi...Show more
Last updated: 30+ days ago • Promoted
Python Developer
Recro • Gurugram, Haryana, India
Implement agentic workflows in Python using an agent framework.Experience with LangGraph, AutoGen, CrewAI, or equivalent is valuable.
Build reliable tool and function calling flows with planning, me...Show more
Last updated: 30+ days ago • Promoted
Senior Backend Developer Python
Verticurl • gurugram, India
Role Title : Senior Backend Developer Python.Work Location : Hyderabad / Gurgaon / Coimbatore - Hybrid.Immediate joiners / 30 days / 45 days.
We are looking for a highly skilled and motivated.The idea...Show more
Last updated: 3 hours ago • Promoted • New!
Python / AWS Developer
vishwavyapi samadhanam services private limited • Gurgaon
Description : Position : Python-AWS Software : 3-7 years Location : Gurugram, panch...Show more
Last updated: 24 days ago • Promoted
Full Stack Engineer - Python / React.js
Talent Pro • Gurugram
Role & Responsibilities : - Design and develop user-friendly web interfaces using HTML, CSS, and JavaScript.Utilize modern frontend frameworks and libraries such as React, ...Show more
Last updated: 30+ days ago • Promoted
Developer / Engineer – AdTech
Collectcent • Gurugram, Haryana, India
Looking for someone to own backend API integrations end-to-end.REST / OAuth2 integrations with external platforms.Designing a unified internal model (Campaign / LineItem / Creative).Normalizing dat...Show more
Last updated: 3 hours ago • Promoted • New!
Software Engineer - Python Technologies
College Dekho • Gurgaon
Description : About the Role : Were looking for a Software Engineer to join our AI team, where we build, deploy, and scale end-to-end AI applica...Show more
Last updated: 12 days ago • Promoted
Ai Web Scraping Engineer
Alternative Path • Gurgaon, Republic Of India, IN
Job title : Web Scraping Engineer Location : Gurgaon About the Role We are looking for a Web Scraping Engineer with proven experience in building, maintaining, and scaling data extraction systems - e...Show more
Last updated: 3 hours ago • Promoted • New!
Prompt Engineer
Tata Consultancy Services • Gurugram, Haryana, India
Greetings from TATA CONSULTANCY SERVICES!!!.TCS is hiring for Prompt Engineer.Notice Period : 0 -15 / 30 days, Immediate joiners are also preferred.
Hands on Experience on NLP Techniques and technologi...Show more
Last updated: 4 days ago • Promoted
Fullstack Python Engineer (Cloud and AI)
Luxoft • Gurugram, Haryana, India
Noida / Hyderabad / Chennai / Gurgaon.Must have experience of maintaining & upgrading.NET based applications on Windows OS / Azure Cloud ,Experience with the MVC.
NET, SSIS, Web Services, Azure Web API, I...Show more
Last updated: 2 days ago • Promoted