Talent.com
No longer accepting applications
Web Scraping Engineer

Web Scraping Engineer

noonpushkar, gujarat, in
1 day ago
Job description

Job title : Web Scraping Engineer

Location : Gurgaon

About the Role

We are looking for a Web Scraping Engineer with proven experience in building, maintaining, and scaling data extraction systems - especially from e-commerce platforms .

The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.) that power our analytics and competitive pricing systems.

What you'll do :

  • Develop and maintain scalable scraping pipelines to extract structured data from complex, dynamic e-commerce sites .
  • Design and manage distributed scraping infrastructure (e.g., rotating proxies, request throttling).
  • Handle dynamic rendering, anti-bot measures, and API integrations where applicable.
  • Implement data quality validation, normalization, and deduplication routines
  • Optimize performance and reliability of scrapers with scheduling, retry logic, and monitoring
  • Collaborate with data engineers and product teams to define data needs and integration workflows.
  • Maintain compliance with relevant site terms of service, data usage policies, and legal constraints.

What you'll need :

  • 3+ years of professional experience in web scraping , data extraction , or automation.
  • Strong Python skills with libraries such as Scrapy , BeautifulSoup , Requests , or aiohttp.
  • Experience with proxy management and anti-bot evasion (e.g., rotating IPs, user agents, cookies, CAPTCHA handling).
  • Solid understanding of HTML , JavaScript , and network protocols (HTTP, REST) .
  • Familiarity with GCP or AWS for deploying scalable scraping systems.
  • Experience storing and processing data using MySQL , Elasticsearch , or S3.
  • Experience scraping product pages (ASINs, listings, offers) and / or using Product Advertising API is strongly preferred .
  • Experience with distributed scraping frameworks (e.g., Scrapyd, Airflow, Celery).
  • Knowledge of data pipelines or ETL design.
  • Experience with competitive pricing , catalog mapping , or e-commerce analytics.
  • Familiarity with Docker and CI / CD tools.
  • Who will excel?

  • We’re looking for people with high standards who understand that hard work matters.
  • You need to be relentlessly resourceful and operate with a deep bias for action.
  • We need people with the courage to be fiercely original.
  • noon is not for everyone; readiness to adapt, pivot, and learn is essential.
  • If the above values resonate with you, then noon might be the place for you!

    Create a job alert for this search

    Web Scraping Engineer • pushkar, gujarat, in

    Related jobs
    • Promoted
    Data Engineer - Web Scraping

    Data Engineer - Web Scraping

    Alternative PathPushkar, IN
    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Full Stack Engineer

    Full Stack Engineer

    SUUVO INCpushkar, gujarat, in
    SUUVO is a fast-growing US social entertainment startup (mobile app).Build the core of SUUVO — feed, profiles, creator tools, and monetization. Work on short-video systems, real-time interactions, n...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Freelance Opportunity : Senior Full Stack Engineer (InterSystems Cache / IRIS + Angular)

    Freelance Opportunity : Senior Full Stack Engineer (InterSystems Cache / IRIS + Angular)

    ThreatXIntelpushkar, gujarat, in
    ThreatXIntel is a startup cyber security company focused on providing businesses and organizations with tailored, cost-effective solutions to protect their digital assets.We specialize in services ...Show moreLast updated: 13 hours ago
    • Promoted
    Full Stack Engineer AI (4-6 YOE)

    Full Stack Engineer AI (4-6 YOE)

    Redica Systemspushkar, gujarat, in
    Redica Systems is a SaaS start-up serving more than 200 customers within the life science sector, with a specific focus on Pharmaceuticals and MedTech. Our workforce is distributed globally, with he...Show moreLast updated: 1 day ago
    • Promoted
    AWS Engineer

    AWS Engineer

    Spryc SystemsAjmer, IN
    We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS...Show moreLast updated: 15 days ago
    • Promoted
    • New!
    Full Stack Engineer

    Full Stack Engineer

    KodeMaster AIajmer, rajasthan, in
    KodeMaster AI is a cutting-edge platform dedicated to helping engineers excel in technical interviews by harnessing the power of artificial intelligence. From coding and system design mock interview...Show moreLast updated: 12 hours ago
    • Promoted
    DevSecOps / AppSecOps Staff Engineer

    DevSecOps / AppSecOps Staff Engineer

    First American (India)Ajmer, IN
    Our people-first culture empowers bold thinkers and passionate technologists to solve real-world challenges through scalable architecture and innovative design. If you're driven by impact, thrive in...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Full Stack Engineer (React + Supabase + AI) (Contract to Hire)

    Full Stack Engineer (React + Supabase + AI) (Contract to Hire)

    Bionesca Ltd.pushkar, gujarat, in
    Bionesca is a cutting-edge AI-dermatology platform focused on creating personalised, data-driven personalised skincare solutions. We are developing a data-driven, digital first assessment tool that ...Show moreLast updated: 13 hours ago
    • Promoted
    Web Crawling Engineer

    Web Crawling Engineer

    Forage AIAjmer, IN
    The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Forage AI is a pioneering A...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Full Stack Engineer

    Full Stack Engineer

    Autosys Industrial Solutions Pvt. Ltd.pushkar, gujarat, in
    Autosys Industrial Solutions Pvt.The company delivers solutions that enhance efficiency, productivity, and quality while reducing environmental impact. Autosys technologies are deployed in plants an...Show moreLast updated: 13 hours ago
    • Promoted
    AWS Lambda Developer

    AWS Lambda Developer

    Tata Consultancy Servicesajmer, rajasthan, in
    TCS is hiring for AWS Lambda Developer.Design and develop serverless applications using AWS Lambda and Python.Collaborate with cross-functional teams to define, design, and ship new features.Ensure...Show moreLast updated: 7 days ago
    • Promoted
    • New!
    Web User Interface Developer

    Web User Interface Developer

    Peak 42 Innovation Labs Pvt LtdAjmer, IN
    Peak 42 Innovation Labs Pvt Ltd is a technology consulting and services company recognized for its 'experience-led everything' philosophy. We specialize in crafting digital experiences that develop ...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Search Engineer

    Search Engineer

    Divit Technologies, Inc.pushkar, gujarat, in
    Key skills : Java, Microservices, Elasticsearch / Solr).Essential Functions and Responsibilities.Design and architect search & recommendations platforms, including next-generation and legacy systems...Show moreLast updated: 13 hours ago
    • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    ProglitePushkar, IN
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 30+ days ago
    • Promoted
    Prompt Engineer

    Prompt Engineer

    R SystemsPushkar, IN
    We are seeking a talented and innovative Prompt Engineer / Conversation Designer to join our dynamic team at Agentic A.The ideal candidate will possess a strong background in designing and maintain...Show moreLast updated: 1 day ago
    • Promoted
    WebMethod Developer

    WebMethod Developer

    MSH IndiaPushkar, IN
    Hiring : Senior webMethods Consultant | 8+ Years Experience | Offshore (India).Join our Integration team as a Senior webMethods Consultant!. We’re looking for an experienced professional who can desi...Show moreLast updated: 26 days ago
    • Promoted
    Full Stack Web Developer

    Full Stack Web Developer

    Decodesajmer, rajasthan, in
    Familiarity with containerization tools (.A maker mindset! you care about both.Build and ship features end-to-end, fast.Work closely with design, product, and other devs to make magic happen.Keep t...Show moreLast updated: 2 days ago
    • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Insight Globalpushkar, gujarat, in
    Duration : 6 month contract with potential to convert permanent.JS; primary codebase is frontend-heavy.Proficient with Git for source code management. Hands on experience with AWS Elastic Beans, EC2,...Show moreLast updated: 30+ days ago