Talent.com
Web Scraping Engineer
Web Scraping Engineernoon • pune, India
No longer accepting applications
Web Scraping Engineer

Web Scraping Engineer

noon • pune, India
6 days ago
Job description

Job title : Web Scraping Engineer

Location : Gurgaon

About the Role

We are looking for a Web Scraping Engineer with proven experience in building, maintaining, and scaling data extraction systems - especially from e-commerce platforms .

The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.) that power our analytics and competitive pricing systems.

What you'll do :

  • Develop and maintain scalable scraping pipelines to extract structured data from complex, dynamic e-commerce sites .
  • Design and manage distributed scraping infrastructure (e.g., rotating proxies, request throttling).
  • Handle dynamic rendering, anti-bot measures, and API integrations where applicable.
  • Implement data quality validation, normalization, and deduplication routines
  • Optimize performance and reliability of scrapers with scheduling, retry logic, and monitoring
  • Collaborate with data engineers and product teams to define data needs and integration workflows.
  • Maintain compliance with relevant site terms of service, data usage policies, and legal constraints.

What you'll need :

  • 3+ years of professional experience in web scraping , data extraction , or automation.
  • Strong Python skills with libraries such as Scrapy , BeautifulSoup , Requests , or aiohttp.
  • Experience with proxy management and anti-bot evasion (e.g., rotating IPs, user agents, cookies, CAPTCHA handling).
  • Solid understanding of HTML , JavaScript , and network protocols (HTTP, REST) .
  • Familiarity with GCP or AWS for deploying scalable scraping systems.
  • Experience storing and processing data using MySQL , Elasticsearch , or S3.
  • Experience scraping product pages (ASINs, listings, offers) and / or using Product Advertising API is strongly preferred .
  • Experience with distributed scraping frameworks (e.g., Scrapyd, Airflow, Celery).
  • Knowledge of data pipelines or ETL design.
  • Experience with competitive pricing , catalog mapping , or e-commerce analytics.
  • Familiarity with Docker and CI / CD tools.
  • Who will excel?

  • We’re looking for people with high standards who understand that hard work matters.
  • You need to be relentlessly resourceful and operate with a deep bias for action.
  • We need people with the courage to be fiercely original.
  • noon is not for everyone; readiness to adapt, pivot, and learn is essential.
  • If the above values resonate with you, then noon might be the place for you!

    Create a job alert for this search

    Web Scraping Engineer • pune, India

    Related jobs
    Web Developer

    Web Developer

    Finlec Technologies LLP • Pune, Maharashtra, India
    Finlec Technologies empowers businesses to thrive in a digital-first world.We deliver custom website and mobile app development, integrated AI and data-driven marketing solutions, and end-to-end UI...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer-Python Web scraping

    Software Engineer-Python Web scraping

    NielsenIQ • Pune, Maharashtra, India
    NIQ Digital Shelf is one of Europes fastest-growing companies in the Retail Analytics space.Every day we collect and process over 60 billion data points from web and mobile sources to power real-ti...Show more
    Last updated: 13 days ago • Promoted
    Full Stack Web Developer (Agentic AI Application)

    Full Stack Web Developer (Agentic AI Application)

    Confidential • Pune, India
    Welcome! You made it to the job description page!.This is a 100% REMOTE job opportunity.You can work from anywhere, given that you have strong internet connectivity and a personal device (laptop) t...Show more
    Last updated: 25 days ago • Promoted
    Python Developer - Web Scraping

    Python Developer - Web Scraping

    Upgrad Rekrut Pvt. Ltd. • Pune
    Python+ Web scrapping and responsibilities : - Develop and maintain web scraping and crawling solutions to extract data from various sources.Write efficient Python sc...Show more
    Last updated: 14 days ago • Promoted
    Junior Web Engineer

    Junior Web Engineer

    Confidential • Pune, India
    TransPerfect helps organizations navigate the global marketplace.It remains founder-led – and has striven to maintain the ethos and drive that led them to grow organically year-on-year for the past...Show more
    Last updated: 25 days ago • Promoted
    Web Crawling Engineer

    Web Crawling Engineer

    Forage AI • Pune, IN
    The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Forage AI is a pioneering A...Show more
    Last updated: 14 days ago • Promoted
    Python Automation & Web Scraping Engineer (2 to 4 yrs)

    Python Automation & Web Scraping Engineer (2 to 4 yrs)

    AIMLEAP • Pune, IN
    Python Automation & Web Scraping Engineer (WFH).Bachelor’s degree in Computer Science / Information Technology.Selenium, BeautifulSoup, Requests. Experience in backend / API development using.Strong s...Show more
    Last updated: 2 days ago • Promoted
    Web Developer

    Web Developer

    Copia Consultancy Services • Pune, Maharashtra, India
    We are seeking a skilled Web Developer proficient in both front-end and back-end technologies to design, develop, and maintain dynamic web applications. The ideal candidate will have hands-on experi...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Web Development Engineer

    Web Development Engineer

    Confidential • Pune
    Educational Qualification : Bachelors degree in computer science, Engineering, or a related field.Good coding and documentation skills. Prior experience of end-to-end development and deployment of ap...Show more
    Last updated: 30+ days ago • Promoted
    Web Designer

    Web Designer

    Sweet • Pune, IN
    Project-based, potential for ongoing work).Sweet is the AI-native business platform built for creators — a business partner that clears the clutter, automates the back-office, and gives creators th...Show more
    Last updated: 2 days ago • Promoted
    AI Web Scraping Engineer

    AI Web Scraping Engineer

    S2T AI - AI-Powered Investigations • Pune, IN
    We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more
    Last updated: 30+ days ago • Promoted
    Web Developer

    Web Developer

    Smart Moves Consultants • Pune, IN
    Design and develop high-performance, responsive web portals using React.Build scalable backend services and APIs with Node. Integrate and optimize Snowflake for secure data storage, querying, and an...Show more
    Last updated: 8 hours ago • Promoted • New!
    Web Developer (Freelance)

    Web Developer (Freelance)

    Sweet • Pune, IN
    Sweet is the AI-native business platform built for creators — a business partner that clears the clutter, automates the back-office, and gives creators the freedom to focus on craft, while Sweet gr...Show more
    Last updated: 1 day ago • Promoted
    Software Engineer - Shopify Tech Stack

    Software Engineer - Shopify Tech Stack

    FoxSell Bundles • Pune, IN
    FoxSell Bundles is a fast-growing e-commerce app company helping merchants create effective product bundles and boost sales on Shopify. We are passionate about enabling online stores to increase the...Show more
    Last updated: 2 days ago • Promoted
    Staff Web Enablement Engineer

    Staff Web Enablement Engineer

    Addepar • Pune, Maharashtra, India
    Addepar is a global technology and data company that helps investment professionals provide the most informed precise guidance for their clients. Hundreds of thousands of users have entrusted Addepa...Show more
    Last updated: 5 days ago • Promoted
    Data Engineer (Webscraping)

    Data Engineer (Webscraping)

    Solytics Partners • Pune, Maharashtra, India
    Solytics Partners is a Global Analytics firm, recognized with multiple industry awards for innovation and excellence.Our team comprises experts with deep knowledge in risk, analytics, AI / ML, AML / FC...Show more
    Last updated: 14 days ago • Promoted
    Web Developer

    Web Developer

    Confidential • Chennai, Pune, Bengaluru / Bangalore
    Develop and maintain responsive websites and web applications.Write clean, efficient, and well-documented code following best practices. Troubleshoot, debug, and upgrade existing web solutions.Colla...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer - Web Scraping

    Data Engineer - Web Scraping

    Alternative Path • Pune, IN
    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show more
    Last updated: 30+ days ago • Promoted