Talent.com
Web Scraping Engineer

Web Scraping Engineer

noonlucknow, India
12 hours ago
Job description

Job title : Web Scraping Engineer

Location : Gurgaon

About the Role

We are looking for a Web Scraping Engineer with proven experience in building, maintaining, and scaling data extraction systems - especially from e-commerce platforms .

The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.) that power our analytics and competitive pricing systems.

What you'll do :

  • Develop and maintain scalable scraping pipelines to extract structured data from complex, dynamic e-commerce sites .
  • Design and manage distributed scraping infrastructure (e.g., rotating proxies, request throttling).
  • Handle dynamic rendering, anti-bot measures, and API integrations where applicable.
  • Implement data quality validation, normalization, and deduplication routines
  • Optimize performance and reliability of scrapers with scheduling, retry logic, and monitoring
  • Collaborate with data engineers and product teams to define data needs and integration workflows.
  • Maintain compliance with relevant site terms of service, data usage policies, and legal constraints.

What you'll need :

  • 3+ years of professional experience in web scraping , data extraction , or automation.
  • Strong Python skills with libraries such as Scrapy , BeautifulSoup , Requests , or aiohttp.
  • Experience with proxy management and anti-bot evasion (e.g., rotating IPs, user agents, cookies, CAPTCHA handling).
  • Solid understanding of HTML , JavaScript , and network protocols (HTTP, REST) .
  • Familiarity with GCP or AWS for deploying scalable scraping systems.
  • Experience storing and processing data using MySQL , Elasticsearch , or S3.
  • Experience scraping product pages (ASINs, listings, offers) and / or using Product Advertising API is strongly preferred .
  • Experience with distributed scraping frameworks (e.g., Scrapyd, Airflow, Celery).
  • Knowledge of data pipelines or ETL design.
  • Experience with competitive pricing , catalog mapping , or e-commerce analytics.
  • Familiarity with Docker and CI / CD tools.
  • Who will excel?

  • We’re looking for people with high standards who understand that hard work matters.
  • You need to be relentlessly resourceful and operate with a deep bias for action.
  • We need people with the courage to be fiercely original.
  • noon is not for everyone; readiness to adapt, pivot, and learn is essential.
  • If the above values resonate with you, then noon might be the place for you!

    Create a job alert for this search

    Web Scraping Engineer • lucknow, India

    Related jobs
    • Promoted
    Web Developer

    Web Developer

    GOODFAITH BRANDING & DIGITAL MARKETINGLucknow, IN
    GOODFAITH Branding & Digital Marketing specializes in creating deeply human, optimally structured and impactful digital branding and marketing strategies rooted in logic. Combining advanced AI tools...Show moreLast updated: 4 days ago
    • Promoted
    Senior Front-End Web Developer (HTML & Bootstrap)

    Senior Front-End Web Developer (HTML & Bootstrap)

    KBM ResortsLucknow, IN
    Copy the following with answers and email to.Number of years and version experience in : .Notice period in current company (or) How soon can you join ? (in days). Attach Resume along with the email.Ar...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Full Stack Engineer - Multi-Agent Platform

    Full Stack Engineer - Multi-Agent Platform

    Mastech Digitallucknow, uttar pradesh, in
    Lead design & development of client / server components for our multi-agent platform.Work closely with AI researchers & product managers to deliver high-quality solutions. Build and maintain secure co...Show moreLast updated: 22 hours ago
    • Promoted
    • New!
    GIS Engineer Web Developer

    GIS Engineer Web Developer

    People Prime Worldwidelucknow, uttar pradesh, in
    About Company : Our Client is a leading Indian multinational IT services and consulting firm.It provides digital transformation, cloud computing, data analytics, enterprise application integration,...Show moreLast updated: 22 hours ago
    • Promoted
    • New!
    Senior Web Scraping Engineer

    Senior Web Scraping Engineer

    Zomunklucknow, uttar pradesh, in
    We're building a product that relies heavily on collecting structured data from a number of known websites.We need someone experienced who can own this part of the system end-to-end; from writing s...Show moreLast updated: 22 hours ago
    • Promoted
    • New!
    Web Scraping Engineer

    Web Scraping Engineer

    noonlucknow, uttar pradesh, in
    Job title : Web Scraping Engineer.The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.Develop and...Show moreLast updated: 22 hours ago
    • Promoted
    Data Engineer - Web Scraping

    Data Engineer - Web Scraping

    Alternative PathLucknow, IN
    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show moreLast updated: 30+ days ago
    • Promoted
    Ai Web Scraping Engineer

    Ai Web Scraping Engineer

    Acuity Knowledge PartnersLucknow, Republic Of India, IN
    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show moreLast updated: 2 days ago
    • Promoted
    Sr. Software Engineer (AWS) - Backend

    Sr. Software Engineer (AWS) - Backend

    ZellerLucknow, IN
    At Zeller, we’re champions for businesses of all sizes, and proud to be a fast-growing Australian scale-up taking on the ambitious goal of reimagining business banking and payments.We believe in a ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Junior AWS Engineer (US Shift)

    Junior AWS Engineer (US Shift)

    Zil Moneylucknow, uttar pradesh, in
    Monitor and manage AWS resources such as EC2, RDS, S3, CloudFront, Route 53, VPC, CloudWatch, CloudTrail, and Lambda during US shift hours. Troubleshoot infrastructure issues and resolve incidents p...Show moreLast updated: 22 hours ago
    • Promoted
    • New!
    Wordpress Web Developer

    Wordpress Web Developer

    WBH Digital Solutions Pvt. Ltd.lucknow, uttar pradesh, in
    WordPress Website Designer & Developer : .We are looking to hire a skilled and at least 2-3 years of hands on working experienced WordPress Website developer to design and implement attractive and fu...Show moreLast updated: 22 hours ago
    • Promoted
    Website Designer

    Website Designer

    CertivoLucknow, IN
    Our AI (CORA) ingests supplier docs and BoMs, validates them against rules, and assembles.You’ll shape how that story is told — designing, building, and optimizing our digital presence in.From land...Show moreLast updated: 14 days ago
    • Promoted
    Full Stack Web Developer

    Full Stack Web Developer

    DecodesLucknow, IN
    Familiarity with containerization tools (.A maker mindset! you care about both.Build and ship features end-to-end, fast.Work closely with design, product, and other devs to make magic happen.Keep t...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Full-stack AI Engineer - Founding Engineer

    Full-stack AI Engineer - Founding Engineer

    Taglynklucknow, uttar pradesh, in
    Build full-stack features end-to-end for our AI hiring platform.Work with LLMs, agentic systems, and voice / speech models to create magical user experiences. Architect scalable systems on AWS and own...Show moreLast updated: 22 hours ago
    • Promoted
    Python Developer – Web Scraping & Automation (3 to 5 yrs)

    Python Developer – Web Scraping & Automation (3 to 5 yrs)

    AIMLEAPLucknow, IN
    Python Developer – Web Scraping & Automation (WFH).Bachelor’s degree in Computer Science / Information Technology .Strong hands-on experience in . Expert in web scraping using Scrapy, BeautifulSoup,...Show moreLast updated: 1 day ago
    • Promoted
    Freelance Deep Web Crawler Engineer (AI-Integrated Data Pipeline)

    Freelance Deep Web Crawler Engineer (AI-Integrated Data Pipeline)

    Sixteen Alpha AIlucknow, uttar pradesh, in
    The crawler will be integrated with an.AI or NLP / LLM-based components.JavaScript, infinite scrolling, or APIs.LLM-based data labeling, or automated content enrichment modules.Airflow, Prefect, or c...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    Webflow Developer

    Webflow Developer

    Summit Tech.auLucknow, IN
    Summit Tech is an Australian technology agency dedicated to providing affordable and innovative online solutions for enterprise companies. Based in Australia, Summit Tech combines cutting-edge techn...Show moreLast updated: 17 hours ago
    • Promoted
    Backend + AI Engineer

    Backend + AI Engineer

    RiviLucknow, IN
    We build AI-first products across travel and beyond.We’re looking for a backend-builder passionate about scalable APIs, microservices, databases, and LLM integrations to power seamless, high-perfor...Show moreLast updated: 30+ days ago