This job offer is not available in your country.

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAPKalyan-Dombivli, IN

6 hours ago

Job description

Python / JavaScript Developer – Web Scraping - 4 to 7 years

Experience : 4 to 7 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor's degree in Computer Science, Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
Skilled in JavaScript for web scraping and automation tasks.
Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.

Optimize scraping pipelines for scalability, reliability, and performance.

Work with Scrapy and related Python frameworks / libraries for crawler development.

Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.

Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.

Implement AI / ML-based solutions in scraping workflows, such as :

Using LLMs for content parsing / cleaning.

Automating CAPTCHA solving and anti-bot evasion.

Improving data matching, deduplication, and entity recognition.

Collaborate with data engineers and product teams to ensure scraped data quality and usability.

Maintain proper documentation, testing, and CI / CD practices for scraper code.

Qualifications

Bachelor's degree in computer science, IT, or related field.

Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium).

Proficiency in JavaScript for handling browser automation and dynamic sites.

Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).

Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).

Experience working with databases (SQL / NoSQL) for storing and processing scraped data.

Hands-on experience in AI / ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing.

Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.

Strong problem-solving skills for dealing with anti-bot measures and rate limits.

Excellent communication and collaboration skills.

Create a job alert for this search

Web Developer • Kalyan-Dombivli, IN

Related jobs

Promoted
New!

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAPThane, IN

Python / JavaScript Developer – Web Scraping - 4 to 7 years.Bachelor's degree in Computer Science, Information Technology. Strong expertise in web scraping with hands-on experience in large-scale data...Show moreLast updated: 6 hours ago

Promoted

Full Stack Developer - Python / React.js

SilverpeopleMumbai

Role : Full Stack Developer Were looking for a hands-on builder who can thrive in a fast-paced startup environment.Youll own features end-to-end, from designing archi...Show moreLast updated: 11 days ago

Promoted

Bitkraft Technologies - Full Stack Developer - Python / React.js

Bitkraft TechnologiesMumbai

Bitkraft Technologies LLP is looking for Full-stack Engineers to join our software engineering team.You will be working across the stack on cutting edge web development projects for our custom serv...Show moreLast updated: 30+ days ago

Promoted

Python Developer for a leading company in ITindustry.

Sperton Global ASNavi Mumbai, Maharashtra, India

JD for Python Developer for a leading IT Company in Trivandrum location.We are looking for a Python Developer who is highly capable of building robust and scalable backend services.The ideal candid...Show moreLast updated: 30+ days ago

Promoted

Sciative Solutions - Senior Full Stack Developer - Python / React.js

Sciative Solutions Private LimitedNavi Mumbai

Job Responsibilities : - Hands on (Full Stack) SaaS application design and development concentrating on Artificial intelligence using big data technologies.Facilitate solution ...Show moreLast updated: 30+ days ago

Promoted

Full Stack AI Developer

WE-MatterMumbai

Job Description : Selected persons day-to-day responsibilities include : - Build Gen-AI video pipelines using Sora, Ru...Show moreLast updated: 30+ days ago

Promoted

Senior Web Developer - Python / Javascript

Beauty Garage LtdMumbai

About the job : Company Description : Beauty Garage India Pvt Ltd is a brand known for innovation, reliability, quality, trust...Show moreLast updated: 3 days ago

Promoted

Junior Python Developer - Web Scraping

WeAssembleMumbai

Junior Python Developer - Web Scraping Mumbai, Maharashtra Work Type : Full Time Were looking for a Junior Python Developer ...Show moreLast updated: 30+ days ago

Promoted

Senior Web Scraping Engineer

S2T AI - AI-Powered InvestigationsThane, IN

We are on the lookout for a highly competent, self-motivated.Gather and process raw data at scale (including writing scripts, web scraping, calling APIs). Able to work independently to complete assi...Show moreLast updated: 30+ days ago

Promoted

Paktolus - Technical Lead - Javascript / Python

PaktolusMumbai

Company Overview : We are a fast-growing technology company that specializes in cutting-edge AI solutions and innovative software applications.Our team is passionate ...Show moreLast updated: 30+ days ago

Promoted

Senior Python Developer - Django / Flask

ENTERPRISE SOFTLABS PVT LTDMumbai

Job Description : Role : Python Developer Job Requirements : - Work experience a...Show moreLast updated: 30+ days ago

Promoted

Backend Developer / Data Scraping / Kubernetes

Daply | Scaling Digital PublishingMumbai, IN

IN ORDER TO BE CONSIDERED FOR THIS ROLE, YOU MUST SUBMIT AN APPLICATION HERE : .Web Scraping / Captcha Control.Show moreLast updated: 7 days ago

Promoted
New!

Senior Web Developer (Next.js, React, Tailwind CSS)- India

Connect Tech+TalentThane, IN

Senior Web Developer - 6+ years of experience | Specializing in Next.Built modern, responsive, and accessible UI views using Next. React, and Tailwind CSS, focused on performance and user experience...Show moreLast updated: 6 hours ago

Promoted

Full Stack Developer - Python / React.js

Evoke HR SolutionsMumbai

We are seeking a versatile and proactive Full Stack Developer to join our team.The ideal candidate will be comfortable working on both the front-end and back-end, contributing to all stages of soft...Show moreLast updated: 24 days ago

Promoted

Java Web Developer

Tata Consultancy ServicesMumbai, Maharashtra, India

Greetings from TCS! We are looking for a Senior Java Developer Experience : 8+ Years Location : Gurgaon / Bangalore / Mumbai Job Description : Java Spring boot Microservices with AWS Devops JD 8 Plus ...Show moreLast updated: 7 days ago

Promoted
New!

AI Web Scraping Engineer

S2T AI - AI-Powered InvestigationsKalyan-Dombivli, IN

We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show moreLast updated: 6 hours ago

Promoted

Python Full Stack Developer - React.js / AngularJS

People Prime World WideMumbai

Job Description : Python Full Stack Developer.Location : Bengaluru, Pune, Mumbai.Experience : 5+ years.About the Role : < / p...Show moreLast updated: 9 days ago

Promoted

Azent - Full Stack Developer - Python / Javascript

Azent overseasMumbai

About us : Azent Overseas Education : At Azent, we seek to revolutionize how students go to study abroad.An international education advisory, backed by years of experience in ed...Show moreLast updated: 25 days ago

Promoted

LearningMate - Senior PHP Developer - Python / React.js

Learningmate SolutionsMumbai

About the Role : We are seeking a highly skilled Senior PHP Developer with full-stack capabilities to join our dynamic team in Mumbai.The ideal ca...Show moreLast updated: 7 days ago

Promoted

Ventura Securities - Full Stack Developer - Python / React.js

Ventura Securities Ltd.Mumbai

About the Company : Ventura is an omnichannel trading and investment platform with a network of branches, sub-brokers and Digital Channels.Founded in 1994, the compa...Show moreLast updated: 30+ days ago