Talent.com
Senior Web Scraping Engineer
Senior Web Scraping EngineerZomunk • sangli, maharashtra, in
Senior Web Scraping Engineer

Senior Web Scraping Engineer

Zomunk • sangli, maharashtra, in
9 days ago
Job description

About us

We're building a product that relies heavily on collecting structured data from a number of known websites. We need someone experienced who can own this part of the system end-to-end; from writing scrapers to making sure they scale and stay reliable.

This is a senior role. We're looking for someone who has already dealt with the real-world problems of web scraping and can work independently.

What you'll do

  • Build and maintain scrapers for 24-30 websites (starting with 6).
  • Handle authenticated sites, sessions, cookies, tokens, etc.
  • Work with search endpoints and dynamic content.
  • Architect the data ingestion pipeline, caching, retries, and queues.
  • Make the scrapers stable and resilient even as websites change.
  • Collaborate closely with our backend team to define and use APIs.
  • Handle scaling, rate limits, and performance.

What we're looking for (hard requirements)

  • 5 - 7+ years of building production-grade web scrapers
  • Strong experience with both API-based scraping and browser automation (Playwright / Puppeteer)
  • Familiarity with proxies / IP rotation and basic anti-bot handling
  • Comfortable with auth flows (cookies, sessions, tokens)
  • Ability to design pipelines : ingestion → clean → store → cache
  • Can work independently and own the scraper system end-to-end
  • Nice to have (not required)

  • Familiarity with Cloudflare's ecosystem.
  • Python, Node.js (TypeScipt only), or Go; any backend language is fine, TypeScript is preferred.
  • Who will do well here

  • You enjoy scrapers that work reliably, and predictably.
  • You think in terms of systems, not quick patches.
  • You can work remotely and manage your own time.
  • You appreciate straightforward communication and minimal bureaucracy.
  • Compensation

    Base : ₹3,00,000 - 4,00,000 per month (36 - 48 LPA). Equity / options are available if you choose to take a lower cash component.

    Create a job alert for this search

    Senior Engineer Web • sangli, maharashtra, in

    Related jobs
    Web Scraper Expert (Part-Time / Freelance) – L4RG

    Web Scraper Expert (Part-Time / Freelance) – L4RG

    Lead For Revenue Generation • sangli, maharashtra, in
    Interested candidates can share their CV at : .You will be responsible for developing reliable, scalable, and efficient data-scraping solutions that support our digital marketing, research, and autom...Show more
    Last updated: 5 hours ago • Promoted • New!
    Full Stack Engineer (4-6 YOE)

    Full Stack Engineer (4-6 YOE)

    Redica Systems • sangli, maharashtra, in
    Redica Systems is a SaaS start-up serving more than 200 customers within the life science sector, with a specific focus on Pharmaceuticals and MedTech. Our workforce is distributed globally, with he...Show more
    Last updated: 3 days ago • Promoted
    Site Reliability Engineer

    Site Reliability Engineer

    HRhelpdesk • sangli, maharashtra, in
    Company is a rapidly growing, private equity backed SaaS product company and provides cloud-based solutions.As a Site Reliability Engineer (SRE), you will be responsible for building and maintainin...Show more
    Last updated: 13 days ago • Promoted
    Senior Fullstack Engineer

    Senior Fullstack Engineer

    Black Dog Labs • sangli, maharashtra, in
    Senior Fullstack Engineer (with Data Engineering Experience).Remote (collaboration across time zones), India or LATAM preferred. Proficient English communication.Full-Stack Engineering / Backend Eng...Show more
    Last updated: 3 days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Programmers.io • sangli, maharashtra, in
    Senior AI-Integrated Software Engineer (.Remote until office reopens, Work from Home.We are looking for a dynamic and innovative. The ideal candidate will bring hands-on experience in AI-assisted de...Show more
    Last updated: 30+ days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • sangli, maharashtra, in
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 3 days ago • Promoted
    Senior Full Stack Engineer

    Senior Full Stack Engineer

    KodeKloud • sangli, maharashtra, in
    DevOps, Cloud Computing, and IT.Our hands‑on learning platform is trusted by.Interviews and onboarding are entirely virtual. Candidates must have the right to work where they reside and be able to o...Show more
    Last updated: 30+ days ago • Promoted
    Senior Azure DevOps Engineer - Contract - Immediate

    Senior Azure DevOps Engineer - Contract - Immediate

    SeniorLife.AI • sangli, maharashtra, in
    Your primary focus will be maintaining stability, security, and CI / CD efficiency within Azure, while architecting the path for migration. Manage AKS clusters, Azure Container Registry, and Azure Dev...Show more
    Last updated: 5 hours ago • Promoted • New!
    Remote GenAI Engineer

    Remote GenAI Engineer

    EazyML • sangli, maharashtra, in
    Remote
    Founded by Bell Labs research veterans, and associated with breakthrough startups like Amelia, EazyML, specializes in Transparent Machine Learning. Early on EazyML founders saw the need for Transpa...Show more
    Last updated: 30+ days ago • Promoted
    Snowflake Administrator - Contract

    Snowflake Administrator - Contract

    Gravity Infosolutions, Inc. • sangli, maharashtra, in
    Manage and optimize Snowflake environments for secure and efficient operations.Handle RBAC, user access, OAuth integrations, and MFA enforcement. Oversee Snowflake resources : warehouses, roles, user...Show more
    Last updated: 7 days ago • Promoted
    Staff Software Engineer - Frontend

    Staff Software Engineer - Frontend

    interface.ai • sangli, maharashtra, in
    Our cutting-edge Generative AI-powered platform serves over 100 banks and credit unions, delivering hyper-personalized customer interactions across voice, chat, and employee-assisting solutions.To ...Show more
    Last updated: 5 hours ago • Promoted • New!
    Full Stack Engineer

    Full Stack Engineer

    Beast Insights • sangli, maharashtra, in
    We’re building the Payment Command Center for high-risk merchants — a platform that helps businesses recover failed payments, prevent chargebacks, and boost approval rates using data and intelligen...Show more
    Last updated: 3 days ago • Promoted
    Site Reliability Engineer

    Site Reliability Engineer

    Pagos Consultants • sangli, maharashtra, in
    This team will play a pivotal role in spearheading innovation.As such, you will have the opportunity to shape the early architecture and design of the system and set the trajectory for its future d...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Snowflake + DBT Engineer (8+ Years)

    Senior Snowflake + DBT Engineer (8+ Years)

    MindBrain • sangli, maharashtra, in
    Job Opportunity : Snowflake + DBT Engineer.We are seeking a highly skilled Snowflake + DBT Engineer to design, build, and optimize scalable cloud-based data platforms. The ideal candidate will have s...Show more
    Last updated: 5 hours ago • Promoted • New!
    Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

    Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

    AIMLEAP • sangli, maharashtra, in
    Python / JavaScript Developer – Web Scraping - 4 to 7 years.Bachelor's degree in Computer Science, Information Technology. Strong expertise in web scraping with hands-on experience in large-scale data...Show more
    Last updated: 30+ days ago • Promoted
    Technical Implementation Engineer

    Technical Implementation Engineer

    Y Meadows • sangli, maharashtra, in
    Technical Implementation Engineer.Y Meadows is a United States-based company specializing in artificial intelligence and automation solutions. We provide a low-code automation platform that streamli...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Forage AI • sangli, maharashtra, in
    Role Overview (Hands‑on Player‑Coach).You’ll work closely with engineers—reviewing designs and PRs, pairing on tricky problems, and raising the bar on architecture, reliability, security, and perfo...Show more
    Last updated: 8 days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Programmers.io • sangli, maharashtra, in
    Job Title : Senior Full Stack Developer (Laravel + Vue).We are seeking highly skilled Senior Full Stack Developers with 7–10 years of experience in Laravel and modern frontend frameworks (Vue.The ca...Show more
    Last updated: 13 days ago • Promoted