Talent.com
Web Scraping Engineer
Web Scraping Engineernoon • India
Web Scraping Engineer

Web Scraping Engineer

noon • India
9 hours ago
Job description

Job title : Web Scraping Engineer

Location : Gurgaon

About the Role

We are looking for a Web Scraping Engineer with proven experience in building, maintaining, and scaling data extraction systems - especially from e-commerce platforms .

The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.) that power our analytics and competitive pricing systems.

What you'll do :

  • Develop and maintain scalable scraping pipelines to extract structured data from complex, dynamic e-commerce sites .
  • Design and manage distributed scraping infrastructure (e.g., rotating proxies, request throttling).
  • Handle dynamic rendering, anti-bot measures, and API integrations where applicable.
  • Implement data quality validation, normalization, and deduplication routines
  • Optimize performance and reliability of scrapers with scheduling, retry logic, and monitoring
  • Collaborate with data engineers and product teams to define data needs and integration workflows.
  • Maintain compliance with relevant site terms of service, data usage policies, and legal constraints.

What you'll need :

  • 3+ years of professional experience in web scraping , data extraction , or automation.
  • Strong Python skills with libraries such as Scrapy , BeautifulSoup , Requests , or aiohttp.
  • Experience with proxy management and anti-bot evasion (e.g., rotating IPs, user agents, cookies, CAPTCHA handling).
  • Solid understanding of HTML , JavaScript , and network protocols (HTTP, REST) .
  • Familiarity with GCP or AWS for deploying scalable scraping systems.
  • Experience storing and processing data using MySQL , Elasticsearch , or S3.
  • Experience scraping product pages (ASINs, listings, offers) and / or using Product Advertising API is strongly preferred .
  • Experience with distributed scraping frameworks (e.g., Scrapyd, Airflow, Celery).
  • Knowledge of data pipelines or ETL design.
  • Experience with competitive pricing , catalog mapping , or e-commerce analytics.
  • Familiarity with Docker and CI / CD tools.
  • Who will excel?

  • We’re looking for people with high standards who understand that hard work matters.
  • You need to be relentlessly resourceful and operate with a deep bias for action.
  • We need people with the courage to be fiercely original.
  • noon is not for everyone; readiness to adapt, pivot, and learn is essential.
  • If the above values resonate with you, then noon might be the place for you!

    Create a job alert for this search

    Web Scraping Engineer • India

    Related jobs
    Web Designer

    Web Designer

    Sweet • Nagpur, IN
    Project-based, potential for ongoing work).Sweet is the AI-native business platform built for creators — a business partner that clears the clutter, automates the back-office, and gives creators th...Show more
    Last updated: 1 day ago • Promoted
    Full Stack Engineer (Frontend focused)

    Full Stack Engineer (Frontend focused)

    BrightEdge • Nagpur, IN
    Just seeking some good talent!.At BrightEdge, we innovate at the intersection of AI, SEO, and enterprise growth.We’re not just shaping the future of enterprise SEO and content performance; we’re al...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Site Reliability Engineer (SRE) / DevOps Engineer

    Freelance Site Reliability Engineer (SRE) / DevOps Engineer

    ThreatXIntel • Nagpur, IN
    ThreatXIntel is a startup cyber security company focused on delivering customized, affordable solutions to protect businesses and organizations from cyber threats. Our experienced team specializes i...Show more
    Last updated: 4 hours ago • Promoted • New!
    Web Crawling Engineer

    Web Crawling Engineer

    Forage AI • Nagpur, IN
    The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Forage AI is a pioneering A...Show more
    Last updated: 13 days ago • Promoted
    Senior Front-End Web Developer (HTML & Bootstrap)

    Senior Front-End Web Developer (HTML & Bootstrap)

    KBM Resorts • Nagpur, IN
    Copy the following with answers and email to.Number of years and version experience in : .Notice period in current company (or) How soon can you join ? (in days). Attach Resume along with the email.Ar...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Web Devoloper

    Full Stack Web Devoloper

    Astroinvite • Nagpur, IN
    Full Stack Developer (Shopify + PHP + WordPress) – Immediate Joiner.Noida, Sector 58 (Work From Office).E-commerce / Astrology & Gemstones (AstroInvite & GemsInvite). We’re looking for a hands-on Fu...Show more
    Last updated: 4 hours ago • Promoted • New!
    Web Developer (Freelance)

    Web Developer (Freelance)

    Sweet • Nagpur, IN
    Sweet is the AI-native business platform built for creators — a business partner that clears the clutter, automates the back-office, and gives creators the freedom to focus on craft, while Sweet gr...Show more
    Last updated: 4 hours ago • Promoted • New!
    Full Stack and AI Engineer

    Full Stack and AI Engineer

    Loam.ai • India, India
    AI Consulting startup that designs and deploys custom artificial‑intelligence solutions for forward‑thinking businesses.We couple state‑of‑the‑art GenAI techniques with rock‑solid engineering to tu...Show more
    Last updated: 2 hours ago • Promoted • New!
    AWS Cloud Engineer

    AWS Cloud Engineer

    Proglite • Nagpur, IN
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack AI engineer

    Full Stack AI engineer

    AnswerThis (YC F25) • Nagpur, IN
    Remote (Applications open worldwide).Semantic Search, Vector Databases, Prompt Engineering, GenAI Frameworks, React Agents, Graph Agents, Document Parsing, Python, Scalable APIs.AnswerThis is an AI...Show more
    Last updated: 30+ days ago • Promoted
    Python Automation & Web Scraping Engineer (2 to 4 yrs)

    Python Automation & Web Scraping Engineer (2 to 4 yrs)

    AIMLEAP • Nagpur, IN
    Python Automation & Web Scraping Engineer (WFH).Bachelor’s degree in Computer Science / Information Technology.Selenium, BeautifulSoup, Requests. Experience in backend / API development using.Strong s...Show more
    Last updated: 1 day ago • Promoted
    Full Stack Wordpress & Shopify Developer

    Full Stack Wordpress & Shopify Developer

    Grow Digitally • Nagpur, IN
    We are looking for a Full Stack Web Developer with 2 years of experience skilled in.WordPress and Shopify development.The ideal candidate will support our website or app development initiatives by ...Show more
    Last updated: 4 hours ago • Promoted • New!
    Full Stack Engineer

    Full Stack Engineer

    RAVSoft Solutions Inc. • Nagpur, IN
    RAVSoft Solutions is focused on providing innovative and high-quality software solutions to healthcare professionals.With its rich experience and expertise for 25 years, RAVSoft is one of the leadi...Show more
    Last updated: 4 hours ago • Promoted • New!
    Software Engineer - Shopify Tech Stack

    Software Engineer - Shopify Tech Stack

    FoxSell Bundles • India, India
    FoxSell Bundles is a fast-growing e-commerce app company helping merchants create effective product bundles and boost sales on Shopify. We are passionate about enabling online stores to increase the...Show more
    Last updated: 20 hours ago • Promoted • New!
    Sr. Software Engineer (AWS) - Backend

    Sr. Software Engineer (AWS) - Backend

    Zeller • India, India
    At Zeller, we’re champions for businesses of all sizes, and proud to be a fast-growing Australian scale-up taking on the ambitious goal of reimagining business banking and payments.We believe in a ...Show more
    Last updated: 30+ days ago • Promoted
    AWS Engineer

    AWS Engineer

    Spryc Systems • India, India
    We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS...Show more
    Last updated: 20 days ago • Promoted
    Shopify Developer

    Shopify Developer

    InstaAstro • Nagpur, IN
    The ideal candidate will have strong web development skills and a solid understanding of programming using.HTML, CSS, JavaScript, jQuery, and either JavaScript or Python. You will be responsible for...Show more
    Last updated: 4 hours ago • Promoted • New!
    Full Stack Engineer

    Full Stack Engineer

    Yamaha Motor Solutions India • Nagpur, IN
    Job Title : Senior Full Stack Developer (React JS + Spring Boot + Java 21).Job Location : Faridabad, Haryana, India.Develop user-friendly, responsive, and high-performance web interfaces using React ...Show more
    Last updated: 4 hours ago • Promoted • New!