Talent.com
Web Scraping Engineer
Web Scraping Engineernoon • Gurgaon, Haryana, India
Web Scraping Engineer

Web Scraping Engineer

noon • Gurgaon, Haryana, India
9 days ago
Job description

Job title : Web Scraping Engineer

Location : Gurgaon

About the Role

We are looking for a Web Scraping Engineer with proven experience in building, maintaining, and scaling data extraction systems - especially from e-commerce platforms .

The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.) that power our analytics and competitive pricing systems.

What you'll do :

Develop and maintain scalable scraping pipelines to extract structured data from complex, dynamic e-commerce sites .

Design and manage distributed scraping infrastructure (e.g., rotating proxies, request throttling).

Handle dynamic rendering, anti-bot measures, and API integrations where applicable.

Implement data quality validation, normalization, and deduplication routines

Optimize performance and reliability of scrapers with scheduling, retry logic, and monitoring

Collaborate with data engineers and product teams to define data needs and integration workflows.

Maintain compliance with relevant site terms of service, data usage policies, and legal constraints.

What you'll need :

3+ years of professional experience in web scraping , data extraction , or automation.

Strong Python skills with libraries such as Scrapy , BeautifulSoup , Requests , or aiohttp.

Experience with proxy management and anti-bot evasion (e.g., rotating IPs, user agents, cookies, CAPTCHA handling).

Solid understanding of HTML , JavaScript , and network protocols (HTTP, REST) .

Familiarity with GCP or AWS for deploying scalable scraping systems.

Experience storing and processing data using MySQL , Elasticsearch , or S3.

Experience scraping product pages (ASINs, listings, offers) and / or using Product Advertising API is strongly preferred .

Experience with distributed scraping frameworks (e.g., Scrapyd, Airflow, Celery).

Knowledge of data pipelines or ETL design.

Experience with competitive pricing , catalog mapping , or e-commerce analytics.

Familiarity with Docker and CI / CD tools.

Who will excel?

We’re looking for people with high standards who understand that hard work matters.

You need to be relentlessly resourceful and operate with a deep bias for action.

We need people with the courage to be fiercely original.

noon is not for everyone; readiness to adapt, pivot, and learn is essential.

If the above values resonate with you, then noon might be the place for you!

Create a job alert for this search

Web Scraping Engineer • Gurgaon, Haryana, India

Related jobs
Mobile / Web QA Engineer

Mobile / Web QA Engineer

BayOne Solutions • Gurugram, Haryana, India
Collaborate with cross-functional teams to understand project requirements.Come up with Test Plan and write Test Cases for Mobile Applications / Web Applications. Execute the Test Cases Manually and p...Show more
Last updated: 5 days ago • Promoted
Web Developer (Freelance)

Web Developer (Freelance)

Sweet • gurgaon, India
Sweet is the AI-native business platform built for creators — a business partner that clears the clutter, automates the back-office, and gives creators the freedom to focus on craft, while Sweet gr...Show more
Last updated: 2 days ago • Promoted
Full Stack Engineer

Full Stack Engineer

UltraShip TMS • gurgaon, India
The team at Ultraship is building a next-gen complete end-to-end Transportation Management System (TMS) that is used by top brokerage firms in Logistics industry. B2B platform with best-in-class use...Show more
Last updated: 5 days ago • Promoted
Staff Software Engineer - Frontend

Staff Software Engineer - Frontend

interface.ai • gurugram, India
Our cutting-edge Generative AI-powered platform serves over 100 banks and credit unions, delivering hyper-personalized customer interactions across voice, chat, and employee-assisting solutions.To ...Show more
Last updated: 3 hours ago • Promoted • New!
Web Developer

Web Developer

Loch Corporate Services • Gurugram, Haryana, India
Loch Corporate Services Private Limited.Gurugram, India (Work from Office mandatory).Loch Corporate Services Private Limited is a professional services firm delivering a broad range of solutions ac...Show more
Last updated: 5 days ago • Promoted
Web Scraper Expert (Part-Time / Freelance) – L4RG

Web Scraper Expert (Part-Time / Freelance) – L4RG

Lead For Revenue Generation • gurgaon, India
Interested candidates can share their CV at : .You will be responsible for developing reliable, scalable, and efficient data-scraping solutions that support our digital marketing, research, and autom...Show more
Last updated: 3 hours ago • Promoted • New!
Full Stack and AI Engineer

Full Stack and AI Engineer

Loam.ai • gurugram, India
AI Consulting startup that designs and deploys custom artificial‑intelligence solutions for forward‑thinking businesses.We couple state‑of‑the‑art GenAI techniques with rock‑solid engineering to tu...Show more
Last updated: 2 days ago • Promoted
DevOps Engineer - AWS

DevOps Engineer - AWS

CloudHire • Gurugram
About the Role : We are seeking an experienced and highly skilled DevOps Engineer with 2+ years of hands-on expertise.In this role, you will lead and optimize CI / CD ...Show more
Last updated: 30+ days ago • Promoted
Web Scraping Engineer

Web Scraping Engineer

noon • Gurugram, Haryana, India
Job title : Web Scraping Engineer.The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.Develop and...Show more
Last updated: 5 days ago • Promoted
Full Stack Engineer (4-6 YOE)

Full Stack Engineer (4-6 YOE)

Redica Systems • gurgaon, India
Redica Systems is a SaaS start-up serving more than 200 customers within the life science sector, with a specific focus on Pharmaceuticals and MedTech. Our workforce is distributed globally, with he...Show more
Last updated: 3 days ago • Promoted
Battery Smart - DevOps Engineer - AWS Infrastructure

Battery Smart - DevOps Engineer - AWS Infrastructure

BatterySmart • Gurugram
Role Overview : We're looking for a DevOps Engineer (SDE I) with a strong foundation in AWS, CI / CD, containerization, and automation to join our high-performance technolog...Show more
Last updated: 10 days ago • Promoted
Website Operations Lead

Website Operations Lead

Honasa Consumer Ltd. • Gurugram, Haryana, India
We are seeking a proactive and skilled Team Lead – Web Operations to oversee the end-to-end management of our brand websites across Shopify and Magento platforms. This role requires strong technical...Show more
Last updated: 8 hours ago • Promoted • New!
Full Stack Engineer

Full Stack Engineer

Transmission • Gurugram, Haryana, India
We’re the world’s largest independent global B2B marketing agency, where curious minds create the future.If you’re someone who’s thought-provoking, ego-quashing, mistake-learning, all-including, co...Show more
Last updated: 30+ days ago • Promoted
Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAP • gurugram, India
Python / JavaScript Developer – Web Scraping - 4 to 7 years.Bachelor's degree in Computer Science, Information Technology. Strong expertise in web scraping with hands-on experience in large-scale data...Show more
Last updated: 3 hours ago • Promoted • New!
DevOps Engineer

DevOps Engineer

Total CollectR Virtual Collector & Debt Negotiator • gurugram, India
SaaS startup with a 30-person technical team.We run one dedicated instance of our LAMP-based application and database per customer, which requires robust automation, monitoring, and scalability.Our...Show more
Last updated: 9 hours ago • Promoted • New!
Full Stack Engineer

Full Stack Engineer

Awign Expert • gurugram, India
Timings : Full Time - IST (As per company timings).Notice Period : (Immediate Joiner - Only).You are interested in the full-stack opportunity and love building a feature from start to finish.Self-sta...Show more
Last updated: 9 hours ago • Promoted • New!
DevOps Engineer

DevOps Engineer

Yum! India Global Services Private Limited • Gurugram, Haryana, India
Forming the Yum Digital Tech Team, you’ll be working across teams to support the DevOps of the Digital products for web and app as well as the integrations to the many external services.Your focus ...Show more
Last updated: 30+ days ago • Promoted
Full Stack Engineer

Full Stack Engineer

Programmers.io • gurugram, India
Job Title : Senior Full Stack Developer (Laravel + Vue).We are seeking highly skilled Senior Full Stack Developers with 7–10 years of experience in Laravel and modern frontend frameworks (Vue.The ca...Show more
Last updated: 12 days ago • Promoted