This job offer is not available in your country.

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAPPalakkad, IN

1 day ago

Job description

Python / JavaScript Developer – Web Scraping - 4 to 7 years

Experience : 4 to 7 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor's degree in Computer Science, Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
Skilled in JavaScript for web scraping and automation tasks.
Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.

Optimize scraping pipelines for scalability, reliability, and performance.

Work with Scrapy and related Python frameworks / libraries for crawler development.

Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.

Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.

Implement AI / ML-based solutions in scraping workflows, such as :

Using LLMs for content parsing / cleaning.

Automating CAPTCHA solving and anti-bot evasion.

Improving data matching, deduplication, and entity recognition.

Collaborate with data engineers and product teams to ensure scraped data quality and usability.

Maintain proper documentation, testing, and CI / CD practices for scraper code.

Qualifications

Bachelor's degree in computer science, IT, or related field.

Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium).

Proficiency in JavaScript for handling browser automation and dynamic sites.

Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).

Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).

Experience working with databases (SQL / NoSQL) for storing and processing scraped data.

Hands-on experience in AI / ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing.

Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.

Strong problem-solving skills for dealing with anti-bot measures and rate limits.

Excellent communication and collaboration skills.

Create a job alert for this search

Web Developer • Palakkad, IN

Related jobs

Promoted

Senior Web Developer (Next.js, React, Tailwind CSS)- India

Connect Tech+TalentThrissur, IN

Senior Web Developer - 6+ years of experience | Specializing in Next.Built modern, responsive, and accessible UI views using Next. React, and Tailwind CSS, focused on performance and user experience...Show moreLast updated: 1 day ago

Promoted
New!

Python Developer

goMLCoimbatore, Tamil Nadu, India

We are in search of a passionate and skilled Python Developer to join our dynamic team.This role is ideal for someone with a profound expertise in Python and its ecosystem, focused on backend devel...Show moreLast updated: less than 1 hour ago

Promoted

Back End Developer ( GO or Python)

Tilda ResearchCoimbatore, IN

REMOTE OPPORTUNITY - Join a Series A Rocketship headed to Series B Funding.We require each candidate to complete coding exercises in either " GO" or " Python. Build scalable back-end services using....Show moreLast updated: 30+ days ago

Promoted

Shopify Developer- Remote | HTML,CSS,JavaScript,Liquid

BirdChimeThrissur, IN

Remote

At BirdChime, we build powerful and easy-to-use Shopify apps that help merchants take control of their time and operations. Our flagship app, Store Pickup and Delivery Date, is trusted by thousands ...Show moreLast updated: 1 day ago

Promoted

AI Web Scraping Engineer

S2T AI - AI-Powered InvestigationsPalakkad, IN

We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show moreLast updated: 1 day ago

Promoted

Senior Web Scraping Engineer

S2T AI - AI-Powered InvestigationsCoimbatore, IN

We are on the lookout for a highly competent, self-motivated.Gather and process raw data at scale (including writing scripts, web scraping, calling APIs). Able to work independently to complete assi...Show moreLast updated: 30+ days ago

Promoted

Backend Developer / Data Scraping / Kubernetes

Daply | Scaling Digital PublishingThrissur, IN

IN ORDER TO BE CONSIDERED FOR THIS ROLE, YOU MUST SUBMIT AN APPLICATION HERE : .Web Scraping / Captcha Control.Show moreLast updated: 8 days ago

Promoted

Python Developer

Spotcheck GlobalCoimbatore

Key Responsibilities : - Design, develop and test robust and scalable backend systems using Python.Develop and integrate RESTful APIs and third-party services.Write c...Show moreLast updated: 30+ days ago

Promoted

Full-Stack Web Developer (React, Vite, Next.js, JS / TS)

AdVran Inc.Thrissur, IN

AdVran is a cybersecurity driven software company delivering custom digital solutions, MSP services, and secure, high-performance web applications. Our team combines cybersecurity engineers, IT spec...Show moreLast updated: 1 day ago

Promoted

Calypso Developer

APPIT Software IncPalakkad, IN

We are looking for Calypso Developer.Total Experience in Years : 5 - 10 years.Top 3 skills which is mandatory.Demonstrable experience (at least 5 years) with Java development, particularly along wi...Show moreLast updated: 8 days ago

Promoted

Next.js Web developer

Sweech Ltd.Thrissur, IN

We are SW company making system software and application for B2B service.We are working with more than 50+ developer in our company. South Korea Seoul / Daegu(Remote).We give about 80,000INR Normally ...Show moreLast updated: 9 days ago

Promoted

Senior Backend Developer

StealthCoimbatore, IN

Fintech Unicorn seeking backend engineers who love building systems that millions trust with their money.Your code directly affects millions of users' financial lives - from seamless payments to sm...Show moreLast updated: 6 days ago

Promoted

Webflow Developer (Contract)

Josysthrissur, kerala, in

Role Type : Contractor / Consultant.Josys is a fast-growing B2B SaaS startup on a mission to simplify and supercharge IT operations worldwide. After a stellar launch in Japan and raising $218M in Seri...Show moreLast updated: 5 days ago

Promoted

Backend Python / AI Engineer

JuiceLabs AIThrissur, IN

Where creative engineering meets applied AI.At JuiceLabs, we’re building vertical AI-native tools that unlock fresh insights and creative superpowers for our clients in advertising, ecommerce, and ...Show moreLast updated: 9 days ago

Promoted

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAPThrissur, IN

Python / JavaScript Developer – Web Scraping - 4 to 7 years.Bachelor's degree in Computer Science, Information Technology. Strong expertise in web scraping with hands-on experience in large-scale data...Show moreLast updated: 1 day ago

Promoted

Google Dialogue Flow Developer

Tata Consultancy ServicesPalakkad, Kerala, India

Google Dialogue Flow Developer Technical Skills : Hands-on experience with Google Dialogflow ES / CX.Strong understanding of NLP, AI, and machine learning concepts. Proficient in programming languages ...Show moreLast updated: 1 day ago

Senior Node.js and Python Azure developer ( AWS to Azure Migration expert)

ScaleneWorksCoimbatore, Tamil Nadu, India

Quick Apply

Python Azure developer ( AWS to Azure Migration expert).Hands-on experience with Azure, Serverless (Azure Functions).AWS to Azure Cloud Migration (Preferred). Hand-on experience in migration of Node...Show moreLast updated: 30+ days ago

Promoted

Sr. Fullstack engineer

Relevance LabCoimbatore, IN

Design, develop, and maintain our AI Agents platform using Python, FastAPI, React, and TypeScript.Collaborate with cross-functional teams, including product managers, designers, and backend enginee...Show moreLast updated: 30+ days ago

Promoted

AI Team Web Developer — React / Tailwind (SaaS)

Visual AIdThrissur, IN

Visual AID is a startup pioneering AI-driven cosmetic surgery planning, focusing on developing a bias-free, inclusive Novel Human-Face Medical Model through rigorous research and medical testing.By...Show moreLast updated: 1 day ago

Promoted

Data Engineer - Web Scrapping & Enrichment

Gala IntelligenceThrissur, IN

We're looking for an entrepreneurial, passionate, and driven.Navneet Tech Venture situated in.As we're building our technology platform from scratch, you'll have the unique opportunity to shape our...Show moreLast updated: 30+ days ago