No longer accepting applications
Senior Web Scraping Engineer
Zomunkthrissur, kerala, in1 day ago
Job description5 - 7+ years of building production-grade web scrapers Strong experience with both API-based scraping and browser automation (Playwright / Puppeteer) Familiarity with proxies / IP rotation and basic anti-bot handling Comfortable with auth flows (cookies, sessions, tokens) Ability to design pipelines : ingestion → clean → store → cache Can work independently and own the scraper system end-to-end Familiarity with Cloudflare's ecosystem. Python, Node.js (TypeScipt only), or Go; any backend language is fine, TypeScript is preferred. You enjoy scrapers that work reliably, and predictably. You think in terms of systems, not quick patches. You can work remotely and manage your own time. You appreciate straightforward communication and minimal bureaucracy.
About us
We're building a product that relies heavily on collecting structured data from a number of known websites. We need someone experienced who can own this part of the system end-to-end; from writing scrapers to making sure they scale and stay reliable.
This is a senior role. We're looking for someone who has already dealt with the real-world problems of web scraping and can work independently.
What you'll do
- Build and maintain scrapers for 24-30 websites (starting with 6).
- Handle authenticated sites, sessions, cookies, tokens, etc.
- Work with search endpoints and dynamic content.
- Architect the data ingestion pipeline, caching, retries, and queues.
- Make the scrapers stable and resilient even as websites change.
- Collaborate closely with our backend team to define and use APIs.
- Handle scaling, rate limits, and performance.
What we're looking for (hard requirements)
Nice to have (not required)
Who will do well here
Compensation
Base : ₹3,00,000 - 4,00,000 per month (36 - 48 LPA). Equity / options are available if you choose to take a lower cash component.
Create a job alert for this search
Senior Web Engineer • thrissur, kerala, in
Related jobs
)
- Promoted
Senior Backend Engineer
VDEXpalakkad, India VDEX is a rapidly-growing perpetual exchange powered by zero knowledge state channels.The exchange recently surpassed $2 billion in volume and is incubated by Binance Labs.Responsibilities and Requ...Show moreLast updated: 1 day ago
- Promoted
- New!
Senior Software Engineer - MERN Stack (Infra / Industrial / Energy)
PeopleGeneMalappuram, Kerala, India Responsibilities : Design, develop, and maintain both front-end and back-end components of web applications Write clean, efficient, and maintainable code using languages such as JavaScript, HTML5, j...Show moreLast updated: 7 hours ago
- Promoted
Senior / Staff Full‑Stack Engineer — CEO’s Build Partner (AI‑Augmented)
TrueyMalappuram, IN Senior / Staff Full‑Stack Engineer — CEO’s Build Partner (AI‑Augmented) 🚀.C2C with your own LLC considered; NO staffing vendors — direct to Truey.
You’ll turn ambiguous ideas into working software : d...Show moreLast updated: 5 days ago
- Promoted
Web Crawling Engineer
Forage AIThrissur, IN The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.
Forage AI is a pioneering A...Show moreLast updated: 8 days ago
- Promoted
Senior Backend Engineer - AI-Augmented Development
TrueyPalakkad, IN Senior Backend Engineer - AI-Augmented Development 🚀.Remote-first | Experience : 5+ years | Type : Full-time.C2C with your own LLC considered.
.We're building the next generation of AI-powered web ap...Show moreLast updated: 25 days ago
- Promoted
Senior Staff Software Engineer - Platform
CoinbasePalakkad, IN Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world.
It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 30+ days ago
- Promoted
Senior Backend Software Engineer
Truxt.aiThrissur, IN As an early-stage company driven by a meaningful mission, we seek exceptional engineering talent who values purpose, long-term impact, and significant equity ownership over traditional salary compe...Show moreLast updated: 15 days ago
- Promoted
AI Web Scraping Engineer
S2T AI - AI-Powered InvestigationsMalappuram, IN We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show moreLast updated: 30+ days ago
- Promoted
Senior Backend Engineer
Blossom SocialMalappuram, IN Blossom Social is building the future of social investing.Our platform empowers retail investors by combining the best of social networks with investing tools—enabling users to connect, learn, and ...Show moreLast updated: 26 days ago
- Promoted
Junior AWS Engineer (US Shift)
Zil MoneyManjeri, Kerala, India Monitor and manage AWS resources such as EC2, RDS, S3, CloudFront, Route 53, VPC, CloudWatch, CloudTrail, and Lambda during US shift hours.
Troubleshoot infrastructure issues and resolve incidents p...Show moreLast updated: 1 day ago
- Promoted
AWS Engineer
Spryc SystemsThrissur, IN We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment.
The ideal candidate will possess deep expertise in AWS...Show moreLast updated: 15 days ago
- Promoted
Web Scraping Engineer
noonMalappuram, Republic Of India, IN Job title : Web Scraping Engineer.The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.Develop and...Show moreLast updated: 1 day ago
- Promoted
Senior Staff Engineer Software-Browser Development
Palo Alto NetworksPālghāt, Republic Of India, IN At Palo Alto Networks® everything starts and ends with our mission : .Being the cybersecurity partner of choice, protecting our digital way of life.
Our vision is a world where each day is safer and m...Show moreLast updated: 1 day ago
- Promoted
Senior Frontend Engineer - AI-Augmented Development
TrueyPalakkad, IN Senior Frontend Engineer - AI-Augmented Development 🚀.Location : Remote-first | Experience : 5+ years | Type : Full-time.
C2C with your own LLC considered; NO staffing vendors — direct to Truey.We’re ...Show moreLast updated: 30+ days ago
- Promoted
Full Stack Web Developer
DecodesThrissur, IN Familiarity with containerization tools (.A maker mindset! you care about both.Build and ship features end-to-end, fast.Work closely with design, product, and other devs to make magic happen.Keep t...Show moreLast updated: 2 days ago
- Promoted
Senior Software Engineer
MS Shift, Inc.palakkad, India Own the end-to-end build of a new, modern company website—from architecture and UI implementation to performance, accessibility, analytics, SEO, and deployment.
You’ll translate requirements into a ...Show moreLast updated: 30+ days ago
- Promoted
Senior Back End Developer
CulviiMalappuram, IN At Culvii, we're building a platform that transforms expertise into artificial domain intelligence, giving professionals effortless ways to weave AI into what they do best.Our mission is to empower...Show moreLast updated: 30+ days ago
- Promoted
Full Stack AI engineer
AnswerThis (YC F25)Thrissur, IN Remote (Applications open worldwide).Semantic Search, Vector Databases, Prompt Engineering, GenAI Frameworks, React Agents, Graph Agents, Document Parsing, Python, Scalable APIs.AnswerThis is an AI...Show moreLast updated: 30+ days ago