Talent.com
No longer accepting applications
Web Scraping Engineer

Web Scraping Engineer

noonKollam, IN
4 days ago
Job description

Job title : Web Scraping Engineer

Location : Gurgaon

About the Role

We are looking for a Web Scraping Engineer with proven experience in building, maintaining, and scaling data extraction systems - especially from e-commerce platforms .

The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.) that power our analytics and competitive pricing systems.

What you'll do :

  • Develop and maintain scalable scraping pipelines to extract structured data from complex, dynamic e-commerce sites .
  • Design and manage distributed scraping infrastructure (e.g., rotating proxies, request throttling).
  • Handle dynamic rendering, anti-bot measures, and API integrations where applicable.
  • Implement data quality validation, normalization, and deduplication routines
  • Optimize performance and reliability of scrapers with scheduling, retry logic, and monitoring
  • Collaborate with data engineers and product teams to define data needs and integration workflows.
  • Maintain compliance with relevant site terms of service, data usage policies, and legal constraints.

What you'll need :

  • 3+ years of professional experience in web scraping , data extraction , or automation.
  • Strong Python skills with libraries such as Scrapy , BeautifulSoup , Requests , or aiohttp.
  • Experience with proxy management and anti-bot evasion (e.g., rotating IPs, user agents, cookies, CAPTCHA handling).
  • Solid understanding of HTML , JavaScript , and network protocols (HTTP, REST) .
  • Familiarity with GCP or AWS for deploying scalable scraping systems.
  • Experience storing and processing data using MySQL , Elasticsearch , or S3.
  • Experience scraping product pages (ASINs, listings, offers) and / or using Product Advertising API is strongly preferred .
  • Experience with distributed scraping frameworks (e.g., Scrapyd, Airflow, Celery).
  • Knowledge of data pipelines or ETL design.
  • Experience with competitive pricing , catalog mapping , or e-commerce analytics.
  • Familiarity with Docker and CI / CD tools.
  • Who will excel?

  • We’re looking for people with high standards who understand that hard work matters.
  • You need to be relentlessly resourceful and operate with a deep bias for action.
  • We need people with the courage to be fiercely original.
  • noon is not for everyone; readiness to adapt, pivot, and learn is essential.
  • If the above values resonate with you, then noon might be the place for you!

    Create a job alert for this search

    Web Scraping Engineer • Kollam, IN

    Related jobs
    • Promoted
    Senior Frontend Engineer - AI-Augmented Development

    Senior Frontend Engineer - AI-Augmented Development

    TrueyThiruvananthapuram, IN
    Senior Frontend Engineer - AI-Augmented Development 🚀.Location : Remote-first | Experience : 5+ years | Type : Full-time. C2C with your own LLC considered; NO staffing vendors — direct to Truey.We’re ...Show moreLast updated: 30+ days ago
    • Promoted
    Full Stack engineer (Backend Heavy) (React / Next / Node / TypeScript / MySQL) Remote

    Full Stack engineer (Backend Heavy) (React / Next / Node / TypeScript / MySQL) Remote

    PropertyLoopThiruvananthapuram, IN
    Remote
    Job Title : Remote - Full Stack Engineer (Backend Heavy).React / Next / Node / TypeScript / MySQL).PropertyLoop is a rapidly growing technology business with the vision, resources, and team to become a glob...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Webflow Developer

    Webflow Developer

    goatdevelopers.comThiruvananthapuram, IN
    From concept to launch, we cover the full spectrum - UI / UX design, backend engineering, AI integration, and frontend development. Our team has successfully partnered with clients across the globe, d...Show moreLast updated: 16 hours ago
    • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    ProgliteAlappuzha, IN
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 30+ days ago
    • Promoted
    Opening for Product Developer / Web developer with leading IT company-Salary upto 30lpa-Remote working

    Opening for Product Developer / Web developer with leading IT company-Salary upto 30lpa-Remote working

    Jobman by Shunya TattvaKollam, IN
    Remote
    We are seeking a skilled React Developer with expertise in Microsoft 365, Azure, C#,.As a Product Developer, you will be responsible. Microsoft 365, Azure, and SharePoint platforms.Designation- Prod...Show moreLast updated: 1 day ago
    • Promoted
    Web Crawling Engineer

    Web Crawling Engineer

    Forage AIThiruvananthapuram, IN
    The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Forage AI is a pioneering A...Show moreLast updated: 11 days ago
    • Promoted
    Senior Front-End Web Developer (HTML & Bootstrap)

    Senior Front-End Web Developer (HTML & Bootstrap)

    KBM ResortsThiruvananthapuram, IN
    Copy the following with answers and email to.Number of years and version experience in : .Notice period in current company (or) How soon can you join ? (in days). Attach Resume along with the email.Ar...Show moreLast updated: 30+ days ago
    • Promoted
    AI Web Scraping Engineer

    AI Web Scraping Engineer

    S2T AI - AI-Powered InvestigationsThiruvananthapuram, IN
    We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Full Stack Web Developer

    Full Stack Web Developer

    GT TechnovationThiruvananthapuram, IN
    Full Stack Web Developer – Internship (Remote).Duration : 1–6 Months (Based on performance & availability).GT Technovation is an emerging tech company focused on building secure, scalable, and moder...Show moreLast updated: 6 hours ago
    • Promoted
    WebMethod Developer

    WebMethod Developer

    MSH IndiaThiruvananthapuram, IN
    Hiring : Senior webMethods Consultant | 8+ Years Experience | Offshore (India).Join our Integration team as a Senior webMethods Consultant!. We’re looking for an experienced professional who can desi...Show moreLast updated: 29 days ago
    • Promoted
    Full Stack AI engineer

    Full Stack AI engineer

    AnswerThis (YC F25)Alappuzha, IN
    Remote (Applications open worldwide).Semantic Search, Vector Databases, Prompt Engineering, GenAI Frameworks, React Agents, Graph Agents, Document Parsing, Python, Scalable APIs.AnswerThis is an AI...Show moreLast updated: 30+ days ago
    • Promoted
    Frontend Engineer

    Frontend Engineer

    Electric MilesAlappuzha, IN
    We're a fast-growing technology company building innovative digital solutions that solve real-world problems in the energy and EV ecosystem. Our engineering team values clean code, continuous learni...Show moreLast updated: 30+ days ago
    • Promoted
    Website Developer – Redesign & Full Revamp Project

    Website Developer – Redesign & Full Revamp Project

    OAK MediaKollam, IN
    We’re a digital marketing agency looking for a creative and skilled Website Developer to help us redesign and relaunch our company website. Our current site is functional but outdated — we’re lookin...Show moreLast updated: 17 days ago
    • Promoted
    AWS Engineer

    AWS Engineer

    Spryc SystemsThiruvananthapuram, IN
    We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS...Show moreLast updated: 18 days ago
    • Promoted
    VMware to XenServer Migration Engineer

    VMware to XenServer Migration Engineer

    TribolaTech IncThiruvananthapuram, IN
    Job Title : VMware to XenServer Migration Engineer.Duration : 1+ month , till end of December.We are seeking a contractor to assist with a critical migration effort, moving workloads from.This is a t...Show moreLast updated: 3 days ago
    • Promoted
    Snowflake Administrator - Contract

    Snowflake Administrator - Contract

    Gravity Infosolutions, Inc.Kollam, IN
    Manage and optimize Snowflake environments for secure and efficient operations.Handle RBAC, user access, OAuth integrations, and MFA enforcement. Oversee Snowflake resources : warehouses, roles, user...Show moreLast updated: 2 days ago
    • Promoted
    Sr. Backend Engineer

    Sr. Backend Engineer

    1DigitalStackThiruvananthapuram, IN
    AI and deep eCommerce data to help global brands grow faster on online marketplaces.Our platforms deliver advanced analytics, actionable intelligence, and media automation — enabling brands to opti...Show moreLast updated: 18 days ago
    • Promoted
    Mid Level Node + AWS Developer

    Mid Level Node + AWS Developer

    xenablerKollam, IN
    We are enabling the world to create the best solution possible through technology & innovation!.Enabler is part of a global tech and business advisory group, with a head office located in Australia...Show moreLast updated: 3 days ago