Talent.com
No longer accepting applications
Web Scraping Engineer

Web Scraping Engineer

noonpalakkad, India
1 day ago
Job description

Job title : Web Scraping Engineer

Location : Gurgaon

About the Role

We are looking for a Web Scraping Engineer with proven experience in building, maintaining, and scaling data extraction systems - especially from e-commerce platforms .

The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.) that power our analytics and competitive pricing systems.

What you'll do :

  • Develop and maintain scalable scraping pipelines to extract structured data from complex, dynamic e-commerce sites .
  • Design and manage distributed scraping infrastructure (e.g., rotating proxies, request throttling).
  • Handle dynamic rendering, anti-bot measures, and API integrations where applicable.
  • Implement data quality validation, normalization, and deduplication routines
  • Optimize performance and reliability of scrapers with scheduling, retry logic, and monitoring
  • Collaborate with data engineers and product teams to define data needs and integration workflows.
  • Maintain compliance with relevant site terms of service, data usage policies, and legal constraints.

What you'll need :

  • 3+ years of professional experience in web scraping , data extraction , or automation.
  • Strong Python skills with libraries such as Scrapy , BeautifulSoup , Requests , or aiohttp.
  • Experience with proxy management and anti-bot evasion (e.g., rotating IPs, user agents, cookies, CAPTCHA handling).
  • Solid understanding of HTML , JavaScript , and network protocols (HTTP, REST) .
  • Familiarity with GCP or AWS for deploying scalable scraping systems.
  • Experience storing and processing data using MySQL , Elasticsearch , or S3.
  • Experience scraping product pages (ASINs, listings, offers) and / or using Product Advertising API is strongly preferred .
  • Experience with distributed scraping frameworks (e.g., Scrapyd, Airflow, Celery).
  • Knowledge of data pipelines or ETL design.
  • Experience with competitive pricing , catalog mapping , or e-commerce analytics.
  • Familiarity with Docker and CI / CD tools.
  • Who will excel?

  • We’re looking for people with high standards who understand that hard work matters.
  • You need to be relentlessly resourceful and operate with a deep bias for action.
  • We need people with the courage to be fiercely original.
  • noon is not for everyone; readiness to adapt, pivot, and learn is essential.
  • If the above values resonate with you, then noon might be the place for you!

    Create a job alert for this search

    Web Scraping Engineer • palakkad, India

    Related jobs
    • Promoted
    • New!
    Full Stack Engineer (React + Supabase + AI) (Contract to Hire)

    Full Stack Engineer (React + Supabase + AI) (Contract to Hire)

    Bionesca Ltd.coimbatore, tamil nadu, in
    Bionesca is a cutting-edge AI-dermatology platform focused on creating personalised, data-driven personalised skincare solutions. We are developing a data-driven, digital first assessment tool that ...Show moreLast updated: 11 hours ago
    • Promoted
    Web Crawling Engineer

    Web Crawling Engineer

    Forage AIThrissur, IN
    The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Forage AI is a pioneering A...Show moreLast updated: 8 days ago
    • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Insight Globalthrissur, kerala, in
    Contract with Insight Global Client.React, React Native, TypeScript.React, React Native, and TypeScript.Deploy containerized solutions using. Ensure high-quality deliverables through.CI / CD pipelines...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Full Stack Engineer (React + Supabase + Ai) (Contract To Hire)

    Full Stack Engineer (React + Supabase + Ai) (Contract To Hire)

    Bionesca Ltd.Trichūr, Republic Of India, IN
    Bionesca is a cutting-edge AI-dermatology platform focused on creating personalised, data-driven personalised skincare solutions. We are developing a data-driven, digital first assessment tool that ...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Full Stack Engineer

    Full Stack Engineer

    Intelebeepalakkad, kerala, in
    Work Experience : 5+ Years at least.We are looking for a Full Stack Developer to join our team.You will work on web applications using JavaScript, React, Node JS and TypeScript.Your job will includ...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    VMware to XenServer Migration Engineer

    VMware to XenServer Migration Engineer

    TribolaTech IncCoimbatore, IN
    Job Title : VMware to XenServer Migration Engineer.Duration : 1+ month , till end of December.We are seeking a contractor to assist with a critical migration effort, moving workloads from.This is a t...Show moreLast updated: 13 hours ago
    • Promoted
    AWS Engineer

    AWS Engineer

    Spryc SystemsThrissur, IN
    We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS...Show moreLast updated: 15 days ago
    • Promoted
    Shopify / Wordpress Web Developer

    Shopify / Wordpress Web Developer

    ConfidentialCoimbatore, India
    We're looking for a creative and detail-oriented Web Developer to join our team full-time! If you have 2 - 3 years of experience and a passion for crafting functional and beautiful websites, we'd l...Show moreLast updated: 19 days ago
    • Promoted
    Sr. Software Engineer (AWS) - Backend

    Sr. Software Engineer (AWS) - Backend

    ZellerThrissur, IN
    At Zeller, we’re champions for businesses of all sizes, and proud to be a fast-growing Australian scale-up taking on the ambitious goal of reimagining business banking and payments.We believe in a ...Show moreLast updated: 30+ days ago
    • Promoted
    Full Stack Web Developer

    Full Stack Web Developer

    DecodesThrissur, IN
    Familiarity with containerization tools (.A maker mindset! you care about both.Build and ship features end-to-end, fast.Work closely with design, product, and other devs to make magic happen.Keep t...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Junior AWS Engineer (US Shift)

    Junior AWS Engineer (US Shift)

    Zil Moneykerala, kerala, in
    Monitor and manage AWS resources such as EC2, RDS, S3, CloudFront, Route 53, VPC, CloudWatch, CloudTrail, and Lambda during US shift hours. Troubleshoot infrastructure issues and resolve incidents p...Show moreLast updated: 18 hours ago
    • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Regie.aiTrichūr, Republic Of India, IN
    Ai is a Series B-funded, AI-native sales engagement automation platform focused on transforming business-critical prospecting — the top of the funnel — into a precise, scalable, and repeatable proc...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Technical Support Engineer

    Technical Support Engineer

    SutherlandCoimbatore, IN
    Job Description : Technical Support Engineer.You will support both on-premises and cloud-based deployments, including AWS-hosted instances, and play a key part in delivering world-class technical as...Show moreLast updated: 13 hours ago
    • Promoted
    Senior Front-End Web Developer (HTML & Bootstrap)

    Senior Front-End Web Developer (HTML & Bootstrap)

    KBM ResortsThrissur, IN
    Copy the following with answers and email to.Number of years and version experience in : .Notice period in current company (or) How soon can you join ? (in days). Attach Resume along with the email.Ar...Show moreLast updated: 30+ days ago
    • Promoted
    Python Developer – Web Scraping & Automation (3 to 5 yrs)

    Python Developer – Web Scraping & Automation (3 to 5 yrs)

    AIMLEAPcoimbatore, tamil nadu, in
    Python Developer – Web Scraping & Automation (WFH).Bachelor’s degree in Computer Science / Information Technology .Strong hands-on experience in . Expert in web scraping using Scrapy, BeautifulSoup,...Show moreLast updated: 2 days ago
    • Promoted
    Webflow Developer

    Webflow Developer

    Summit Tech.auPālghāt, Republic Of India, IN
    Summit Tech is an Australian technology agency dedicated to providing affordable and innovative online solutions for enterprise companies. Based in Australia, Summit Tech combines cutting-edge techn...Show moreLast updated: 1 day ago
    • Promoted
    Full Stack AI engineer

    Full Stack AI engineer

    AnswerThis (YC F25)Thrissur, IN
    Remote (Applications open worldwide).Semantic Search, Vector Databases, Prompt Engineering, GenAI Frameworks, React Agents, Graph Agents, Document Parsing, Python, Scalable APIs.AnswerThis is an AI...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Web Scraping

    Data Engineer - Web Scraping

    Alternative PathPalakkad, IN
    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show moreLast updated: 30+ days ago