This job offer is not available in your country.

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAPchennai, tamil nadu, in

14 hours ago

Job description

Python / JavaScript Developer – Web Scraping - 4 to 7 years

Experience : 4 to 7 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor's degree in Computer Science, Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
Skilled in JavaScript for web scraping and automation tasks.
Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.

Optimize scraping pipelines for scalability, reliability, and performance.

Work with Scrapy and related Python frameworks / libraries for crawler development.

Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.

Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.

Implement AI / ML-based solutions in scraping workflows, such as :

Using LLMs for content parsing / cleaning.

Automating CAPTCHA solving and anti-bot evasion.

Improving data matching, deduplication, and entity recognition.

Collaborate with data engineers and product teams to ensure scraped data quality and usability.

Maintain proper documentation, testing, and CI / CD practices for scraper code.

Qualifications

Bachelor's degree in computer science, IT, or related field.

Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium).

Proficiency in JavaScript for handling browser automation and dynamic sites.

Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).

Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).

Experience working with databases (SQL / NoSQL) for storing and processing scraped data.

Hands-on experience in AI / ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing.

Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.

Strong problem-solving skills for dealing with anti-bot measures and rate limits.

Excellent communication and collaboration skills.

Create a job alert for this search

Web Developer • chennai, tamil nadu, in

Related jobs

Promoted

Senior Web Scraping Engineer

S2T AI - AI-Powered InvestigationsChennai, IN

We are on the lookout for a highly competent, self-motivated.Gather and process raw data at scale (including writing scripts, web scraping, calling APIs). Able to work independently to complete assi...Show moreLast updated: 30+ days ago

Promoted
New!

AI Web Scraping Engineer

S2T AI - AI-Powered InvestigationsChennai, IN

We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show moreLast updated: 18 hours ago

Promoted

Ideal Tech Labs - MEAN Stack Developer - MongoDB / Express.js

IDEAL TECHLABS PRIVATE LIMITEDChennai

Job Title : MEAN Stack Developer Job Location : Chennai, Tamil Nadu Job Type : Full-time Show moreLast updated: 30+ days ago

Promoted

Keuro Life - Backend Developer - Python

Keuro LifeChennai

Job Title : Python Developer (5+ Years of Experience) Company : Keuro Digital Location : Chennai Employment Type : Full-Time ...Show moreLast updated: 10 days ago

Promoted

Valor PayTech - Python AWS Developer - API Gateway

Valor Paytech India Private LimitedChennai

Responsibilities : - Develop and maintain backend systems using Python.Build and optimize serverless solutions with AWS ...Show moreLast updated: 15 days ago

Backend Developer (Java / Python)

Saaki Argus & Averil ConsultingChennai, Tamil Nadu, India

Quick Apply

One of the leading Engineering and R&D Software Services Company.Bachelor s degree in Computer Science, Engineering, or a related field. Proven experience as a Backend Developer with strong prof...Show moreLast updated: 30+ days ago

Promoted

Backend Developer / Data Scraping / Kubernetes

Daply | Scaling Digital PublishingChennai, IN

IN ORDER TO BE CONSIDERED FOR THIS ROLE, YOU MUST SUBMIT AN APPLICATION HERE : .Web Scraping / Captcha Control.Show moreLast updated: 7 days ago

Promoted
New!

Senior Web Developer (Next.js, React, Tailwind CSS)- India

Connect Tech+TalentChennai, IN

Senior Web Developer - 6+ years of experience | Specializing in Next.Built modern, responsive, and accessible UI views using Next. React, and Tailwind CSS, focused on performance and user experience...Show moreLast updated: 18 hours ago

Promoted

Webflow Developer (Contract)

Josyschennai, tamil nadu, in

Role Type : Contractor / Consultant.Josys is a fast-growing B2B SaaS startup on a mission to simplify and supercharge IT operations worldwide. After a stellar launch in Japan and raising $218M in Seri...Show moreLast updated: 4 days ago

Promoted

Full Stack Developer - Javascript / Python

Milestone IncChennai

We are looking for a highly skilled and motivated- Full Stack Developer- with 3-10 years of experience to join our dynamic team. The ideal candidate should have a strong command of- JavaScript, Pyth...Show moreLast updated: 25 days ago

Promoted

Linarc Inc - Senior Full Stack Developer - Python / React.js

LinarcChennai

About Linarc : Linarc is revolutionizing the construction industry.As the emerging leader in construction technology, we are redefining how project...Show moreLast updated: 14 days ago

Promoted

Noww - Senior WebSphere MQ Developer

Nowwin International Pvt LtdChennai

Job Title : IBM Integration Bus (IIB) / WebSphere Integration Developer Full : Chennai, : 5- 8 Type : Full Summary : Show moreLast updated: 30+ days ago

Promoted

Grid Dynamics - Senior Full Stack Developer - Java / React.js

Grid DynamicsChennai

We are seeking a skilled and motivated Senior Full Stack Developer with expertise in Java (Or) Python, Reactjs (Or) AngularJS, and any Cloud to join our agile development team.You will be responsib...Show moreLast updated: 7 days ago

Promoted
New!

Python Full Stack Developer

The Judge GroupChennai

A Python Full Stack Developer designs, builds, and maintains web applications using Python for the back-end and various front-end technologies to create a complete user experience.Key responsibilit...Show moreLast updated: 8 hours ago

Promoted
New!

Google Dialogue Flow Developer

Tata Consultancy ServicesSaint Thomas Mount, Tamil Nadu, India

Google Dialogue Flow Developer Technical Skills : Hands-on experience with Google Dialogflow ES / CX.Strong understanding of NLP, AI, and machine learning concepts. Proficient in programming languages ...Show moreLast updated: 1 hour ago

FTE_Peerislands_Java Polyglot_Remote_6-Mar-25

DiamondpickChennai, Tamil Nadu, India

Remote

Quick Apply

Job Title : Java & Python Developer.Combination of backend technologies Gen AI or Python or.We are looking for a skilled Java & Python Developer with 3 to 5 years of experience to join our t...Show moreLast updated: 30+ days ago

Python+ReactJS Fullstack Developer

ScaleneWorksChennai, Tamil Nadu, India

Quick Apply

Design, develop, and maintain scalable and efficient web applications using Python with an API-first approach.Implement back-end web services utilizing AWS technologies to ensure scalability, relia...Show moreLast updated: 30+ days ago

Promoted

Python Full Stack Developer - AngularJS

N Human Resources and Management SystemsChennai

We are seeking a highly experienced Python Full Stack Developer with strong leadership abilities and a proven track record in UI / Backend development, database management, and DevOps practices.This ...Show moreLast updated: 30+ days ago

Promoted
New!