Talent.com
Web Scraping Engineer
Web Scraping Engineernoon • India
No longer accepting applications
Web Scraping Engineer

Web Scraping Engineer

noon • India
1 day ago
Job description

Job title : Web Scraping Engineer

Location : Gurgaon

About the Role

We are looking for a Web Scraping Engineer with proven experience in building, maintaining, and scaling data extraction systems - especially from e-commerce platforms .

The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.) that power our analytics and competitive pricing systems.

What you'll do :

  • Develop and maintain scalable scraping pipelines to extract structured data from complex, dynamic e-commerce sites .
  • Design and manage distributed scraping infrastructure (e.g., rotating proxies, request throttling).
  • Handle dynamic rendering, anti-bot measures, and API integrations where applicable.
  • Implement data quality validation, normalization, and deduplication routines
  • Optimize performance and reliability of scrapers with scheduling, retry logic, and monitoring
  • Collaborate with data engineers and product teams to define data needs and integration workflows.
  • Maintain compliance with relevant site terms of service, data usage policies, and legal constraints.

What you'll need :

  • 3+ years of professional experience in web scraping , data extraction , or automation.
  • Strong Python skills with libraries such as Scrapy , BeautifulSoup , Requests , or aiohttp.
  • Experience with proxy management and anti-bot evasion (e.g., rotating IPs, user agents, cookies, CAPTCHA handling).
  • Solid understanding of HTML , JavaScript , and network protocols (HTTP, REST) .
  • Familiarity with GCP or AWS for deploying scalable scraping systems.
  • Experience storing and processing data using MySQL , Elasticsearch , or S3.
  • Experience scraping product pages (ASINs, listings, offers) and / or using Product Advertising API is strongly preferred .
  • Experience with distributed scraping frameworks (e.g., Scrapyd, Airflow, Celery).
  • Knowledge of data pipelines or ETL design.
  • Experience with competitive pricing , catalog mapping , or e-commerce analytics.
  • Familiarity with Docker and CI / CD tools.
  • Who will excel?

  • We’re looking for people with high standards who understand that hard work matters.
  • You need to be relentlessly resourceful and operate with a deep bias for action.
  • We need people with the courage to be fiercely original.
  • noon is not for everyone; readiness to adapt, pivot, and learn is essential.
  • If the above values resonate with you, then noon might be the place for you!

    Create a job alert for this search

    Web Scraping Engineer • India

    Related jobs
    Site Reliability Engineer

    Site Reliability Engineer

    Datum Technologies Group • Nagpur, IN
    Job Title : Site Reliability Engineer (SRE) – AWS.AWS, Terraform, Kubernetes, Docker, Grafana, Prometheus, Datadog.We are looking for a skilled Site Reliability Engineer (SRE) with strong AWS experi...Show more
    Last updated: 8 days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Zosma AI • Nagpur, IN
    We're looking for a talented Full Stack Engineer to join our team and help us build the future of Voice AI!.You'll be working on cutting-edge AI solutions, combining backend excellence with intelli...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Full Stack Engineer (Frontend focused)

    Full Stack Engineer (Frontend focused)

    BrightEdge • Nagpur, IN
    Just seeking some good talent!.At BrightEdge, we innovate at the intersection of AI, SEO, and enterprise growth.We’re not just shaping the future of enterprise SEO and content performance; we’re al...Show more
    Last updated: 30+ days ago • Promoted
    Web Crawling Engineer

    Web Crawling Engineer

    Forage AI • Nagpur, IN
    The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Forage AI is a pioneering A...Show more
    Last updated: 8 days ago • Promoted
    Freelance Webflow Developer

    Freelance Webflow Developer

    Black Piano • India
    We are looking for a talented and detail-oriented.In this role, you will be responsible for translating high-fidelity designs into responsive, pixel-perfect websites using Webflow.You’ll collaborat...Show more
    Last updated: 14 days ago • Promoted
    Ai Web Scraping Engineer

    Ai Web Scraping Engineer

    S2T AI - AI-Powered Investigations • Republic Of India, IN
    We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more
    Last updated: 30+ days ago • Promoted
    Web Scraping Solutions Engineer

    Web Scraping Solutions Engineer

    AIMLEAP • Republic Of India, IN
    Python Developer – Web Scraping & Automation (WFH).Bachelor’s degree in Computer Science / Information Technology.Expert in web scraping using Scrapy, BeautifulSoup, Selenium, Playwright, and Reque...Show more
    Last updated: 2 days ago • Promoted
    Web Scraping and Data Pipeline Engineer

    Web Scraping and Data Pipeline Engineer

    Alternative Path • Republic Of India, IN
    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show more
    Last updated: 27 days ago • Promoted
    Remote Web Application Engineer

    Remote Web Application Engineer

    PropertyLoop • Republic Of India, IN
    Remote
    Job Title : Remote - Full Stack Engineer (Backend Heavy).React / Next / Node / TypeScript / MySQL).PropertyLoop is a rapidly growing technology business with the vision, resources, and team to become a glob...Show more
    Last updated: 30+ days ago • Promoted
    Next.js & React Frontend Engineer

    Next.js & React Frontend Engineer

    Ravan.AI • Nagpur, IN
    If you're passionate about crafting high-performance web interfaces, delivering seamless user experiences, and contributing to cutting-edge AI-powered products, we want to hear from you!.Build dyna...Show more
    Last updated: 1 hour ago • Promoted • New!
    Full Stack Engineer

    Full Stack Engineer

    EaseMyTrip.com • Nagpur, IN
    As a Full Stack Developer at EaseMyTrip.This role involves working with the latest technologies, including ASP.Net, C#, and AngularJS, to design, build, and deploy features that enhance user experi...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Data Engineer - Web Scraping

    Data Engineer - Web Scraping

    Alternative Path • India, India
    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show more
    Last updated: 30+ days ago • Promoted
    Web Scraping and Automation Engineer

    Web Scraping and Automation Engineer

    S2T AI - AI-Powered Investigations • Republic Of India, IN
    We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Engineer - Type Script (Contract)

    Full Stack Engineer - Type Script (Contract)

    Employ • Nagpur, IN
    Full-Time Contract Opportunity : Full Stack Engineer- TypeScript.Duration- 3-4 weeks with a possible 3-month extension.Integrate existing APIs into MCP server environments.Build high-quality mock AP...Show more
    Last updated: 1 hour ago • Promoted • New!
    Robotics Software Engineer

    Robotics Software Engineer

    Destro • Nagpur, IN
    Hybrid – Pune (Remote Considered).Destro AI is building the global intelligence layer for robotics — the agentic decision-making brain that tells any robot . While most robotics companies focus on a...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    AI Web Scraping Engineer

    AI Web Scraping Engineer

    S2T AI - AI-Powered Investigations • India, India
    We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more
    Last updated: 30+ days ago • Promoted
    AWS Engineer

    AWS Engineer

    Spryc Systems • Nagpur, IN
    We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS...Show more
    Last updated: 16 days ago • Promoted
    Senior Web Scraping Engineer

    Senior Web Scraping Engineer

    Zomunk • Republic Of India, IN
    We're building a product that relies heavily on collecting structured data from a number of known websites.We need someone experienced who can own this part of the system end-to-end;.We're looking ...Show more
    Last updated: 1 day ago • Promoted