Python Web Scraping Engineer – Automation (3 To 10 Yrs)AIMLEAP • Gurgaon, Republic Of India, IN
Python Web Scraping Engineer – Automation (3 To 10 Yrs)
AIMLEAP • Gurgaon, Republic Of India, IN
3 hours ago
Job descriptionDevelop and maintain high-scale automated scraping workflows for dynamic and protected websites. Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering. Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms. Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling. Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets. 3–10 years of experience in Python-based web scraping and automation . Strong experience in Selenium, Playwright, Puppeteer , and browser automation. Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy . Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies. Understanding of SQL / NoSQL databases for structured data storage. Experience working with AWS / GCP / Azure is a plus. Strong debugging, analytical, and problem-solving skills.
Python Web Scraping Engineer – Advanced Automation (WFH)
Experience : 3–10 Years
Location : Remote (Work from Home)
Mode of Engagement : Full-time
No of Positions : 8
Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field
Industry : IT / Software Services / Data & AI
Notice Period : Immediate Joiners Preferred
What We Are Looking For
- Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
- Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
- Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
- Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
- Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.
Responsibilities
Qualifications
Create a job alert for this search
Automation Engineer • Gurgaon, Republic Of India, IN
Related jobs
Python Web Scraping Engineer – Automation (3 to 10 yrs)
AIMLEAP • gurugram, uttar pradesh, in
Python Web Scraping Engineer – Advanced Automation (WFH).Bachelor’s degree in Computer Science, IT, or related field .IT / Software Services / Data & AI .
Strong hands-on experience handling.Seleniu...Show more
Last updated: 7 hours ago • Promoted • New!
Python / AWS Developer
vishwavyapi samadhanam services private limited • Gurugram
Description : Position : Python-AWS Software : 3-7 years Location : Gurugram, panch...Show more
Last updated: 23 days ago • Promoted
Publicis Sapient - Lead Product Engineer - Python Technologies
TLG INDIA PRIVATE LIMITED • Gurugram
Description : As a Lead product Engineer (Sr.Manager), you will be responsible for driving the end-to-end product engineering lifecycle, from ideat...Show more
Last updated: 30+ days ago • Promoted
Backend Python Engineer - 17852
Turing • Gurugram, Haryana, India
We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models think, reason, and ...Show more
Last updated: 6 days ago • Promoted
AI Developer - Python / C#
Skyleaf • Gurugram
Description : Hiring : AI Developer Experience : 3-7 years Location : Gurugram Work Mode : WFO (UK Shift) Show more
Last updated: 10 days ago • Promoted
Web Scraping Engineer
noon • Gurugram, Haryana, India
Job title : Web Scraping Engineer.The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.Develop and...Show more
Last updated: 6 days ago • Promoted
Full Stack Engineer (Python + JS / TS) - 17853
Turing • Gurgaon, Haryana, India
Role Overview : Turing is seeking experienced Full Stack Engineers to help build end-to-end AI-driven applications for US customers — spanning backend services, web frontends, and evaluation tooling...Show more
Last updated: 22 days ago • Promoted
Python Developer
Recro • Gurgaon, Haryana, India
Role- Responsibilities • Implement agentic workflows in Python using an agent framework.Experience with LangGraph, AutoGen, CrewAI, or equivalent is valuable.
Build reliable tool and function callin...Show more
Last updated: 30+ days ago • Promoted
Full Stack Engineer - Python / React.js
Naukari Wale • Gurugram
Description : We are seeking a highly skilled and passionate Full-Stack Developer who thrives in fast-paced, ambiguous environments and enjoys building scalable produ...Show more
Last updated: 30+ days ago • Promoted
Senior Developer - Python / React.js
C G Vak Softwares & Exports Limited • Gurgaon
Description : Role & Responsibilities : - Design and deve...Show more
Last updated: 8 days ago • Promoted
Python Developer
TekXera • gurugram, uttar pradesh, in
Senior Python Engineer – Service Implementation.India | Pakistan | Nigeria | Kenya | Egypt | Ghana | Bangladesh | Turkey | Mexico.
Full-Time Contract (9 Months, Extendable).San Francisco–based AI re...Show more
Last updated: 7 hours ago • Promoted • New!
Developer / Engineer – AdTech
Collectcent • Gurugram, Haryana, India
Looking for someone to own backend API integrations end-to-end.REST / OAuth2 integrations with external platforms.Designing a unified internal model (Campaign / LineItem / Creative).Normalizing dat...Show more
Last updated: 5 hours ago • Promoted • New!
Python Developer - 17852
Turing • Gurgaon, Haryana, India
Role Overview : We’re looking for experienced Python developers to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models thi...Show more
Last updated: 30+ days ago • Promoted
Axtria - Lead Full Stack Developer - Python / React.js
Axtria India Pvt Ltd • Gurgaon
Designation : Senior Engineer | Lead Engineer Location : Bengaluru, Gurugram , Noida , Pune , Hyderabad Job Purpose : ...Show more
Last updated: 30+ days ago • Promoted
Fullstack Python Engineer (Cloud and AI)
Luxoft • Gurgaon, Haryana, India
Work location : Noida / Hyderabad / Chennai / Gurgaon Project Description : Must have experience of maintaining & upgrading.
NET based applications on Windows OS / Azure Cloud ,Experience with the MVC.NE...Show more
Last updated: 2 days ago • Promoted
Full Stack Engineer - Python / React.js
Talent Pro • Gurugram
Role & Responsibilities : - Design and develop user-friendly web interfaces using HTML, CSS, and JavaScript.Utilize modern frontend frameworks and libraries such as React, ...Show more
Last updated: 30+ days ago • Promoted
Software Engineer - Python Technologies
College Dekho • Gurugram
Description : About the Role : Were looking for a Software Engineer to join our AI team, where we build, deploy, and scale end-to-end AI applica...Show more
Last updated: 11 days ago • Promoted
Prompt Engineer
Tata Consultancy Services • Gurugram, Haryana, India
Greetings from TATA CONSULTANCY SERVICES!!!.TCS is hiring for Prompt Engineer.Notice Period : 0 -15 / 30 days, Immediate joiners are also preferred.
Hands on Experience on NLP Techniques and technologi...Show more
Last updated: 4 days ago • Promoted