This job offer is not available in your country.

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAPpune, maharashtra, in

2 days ago

Job description

Python / JavaScript Developer – Web Scraping - 4 to 7 years

Experience : 4 to 7 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor's degree in Computer Science, Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
Skilled in JavaScript for web scraping and automation tasks.
Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.

Optimize scraping pipelines for scalability, reliability, and performance.

Work with Scrapy and related Python frameworks / libraries for crawler development.

Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.

Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.

Implement AI / ML-based solutions in scraping workflows, such as :

Using LLMs for content parsing / cleaning.

Automating CAPTCHA solving and anti-bot evasion.

Improving data matching, deduplication, and entity recognition.

Collaborate with data engineers and product teams to ensure scraped data quality and usability.

Maintain proper documentation, testing, and CI / CD practices for scraper code.

Qualifications

Bachelor's degree in computer science, IT, or related field.

Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium).

Proficiency in JavaScript for handling browser automation and dynamic sites.

Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).

Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).

Experience working with databases (SQL / NoSQL) for storing and processing scraped data.

Hands-on experience in AI / ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing.

Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.

Strong problem-solving skills for dealing with anti-bot measures and rate limits.

Excellent communication and collaboration skills.

Create a job alert for this search

Web Developer • pune, maharashtra, in

Related jobs

Promoted

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAPPune, IN

Python / JavaScript Developer – Web Scraping - 4 to 7 years.Bachelor's degree in Computer Science, Information Technology. Strong expertise in web scraping with hands-on experience in large-scale data...Show moreLast updated: 2 days ago

Promoted

React with Python

InfoBeansPune, Maharashtra, India

Job title : React Developer with Python.Notice Period : Immediate to 15 days, Serving notice.We are seeking a skilled and motivated. The ideal candidate will be responsible for developing robust fro...Show moreLast updated: 30+ days ago

Promoted

Python Developer

Tata Consultancy ServicesPune, Maharashtra, India

Role : Python Frontend Web Developer.Experience Range : 5 – 10 Years.Location : Pune, Hyderabad, Bangalore, Noida, Kochi, Gurugram. Python Flask / Django web development.Javascript frameworks such as A...Show moreLast updated: 30+ days ago

Promoted

Python Dev Lead with React

Persistent SystemsPune, Maharashtra, India

About Position : Technical Architect with expert knowledge in Python (Django, Flask) and React frontend technologies, combined with strong expertise in the Travel and Hospitality industry.The candi...Show moreLast updated: 19 days ago

Promoted

Full Stack Developer - Python / React.js

Aidewiser SoltekPune

Key Responsibilities : - Design, develop, and maintain scalable full stack applications using modern web technologies.Build secure and performant RESTful APIs using Python (Fas...Show moreLast updated: 27 days ago

Promoted
New!

Python Azure Developer

InfoBeansPune, Maharashtra, India

Experience Required - 8+ Years.Location - Indore / Pune / Bangalore / Chennai (Hybrid).Develop highly scalable applications in Core Python. Experience working with any of the Python web frameworks (Dja...Show moreLast updated: 8 hours ago

Promoted

Senior Full Stack Developer - Python / React.js / AngularJS

HyrEzy Talent SolutionsPune

Position - Sr Full Stack Exp - 5-7 years Reporting to - Lead Engineer Team Size - 5 - We are looking for a Full Stack Dev...Show moreLast updated: 30+ days ago

Promoted

AI Web Scraping Engineer

S2T AI - AI-Powered InvestigationsPune, IN

We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show moreLast updated: 2 days ago

Promoted
New!

Python Developer

ITC InfotechPune, Maharashtra, India

Develop, test and maintain applications with established processes while building holistic understanding of the underlying applications in SRE (Site Reliability Engineering) domain.This will be Ind...Show moreLast updated: 8 hours ago

Promoted

Python Developer

Cavista TechnologiesPune, Maharashtra, India

At Cavista, our mission is to empower organizations with the world’s best technology solutions.We ensure the highest level of client satisfaction through a global network of innovation, and our sof...Show moreLast updated: 30+ days ago

Promoted

Senior Javascript Developer

Cloudnaut TechnologiesPune, Maharashtra, India

Cloudnaut Technologies is a passionate, people-driven company based in Pune, India.We are known for our innovative approach and startup-like culture. Our team is dedicated to exploring new and emerg...Show moreLast updated: 9 days ago

Promoted

Senior Web Scraping Engineer

S2T AI - AI-Powered InvestigationsPune, IN

We are on the lookout for a highly competent, self-motivated.Gather and process raw data at scale (including writing scripts, web scraping, calling APIs). Able to work independently to complete assi...Show moreLast updated: 30+ days ago

Promoted

Senior Web Developer (Next.js, React, Tailwind CSS)- India

Connect Tech+TalentPune, IN

Senior Web Developer - 6+ years of experience | Specializing in Next.Built modern, responsive, and accessible UI views using Next. React, and Tailwind CSS, focused on performance and user experience...Show moreLast updated: 2 days ago

Promoted

Webflow Developer (Contract)

Josyspune, maharashtra, in

Role Type : Contractor / Consultant.Josys is a fast-growing B2B SaaS startup on a mission to simplify and supercharge IT operations worldwide. After a stellar launch in Japan and raising $218M in Seri...Show moreLast updated: 6 days ago

Promoted

Full Stack Developer - Python / Django

RSQUARESOFT TECHNOLOGIES INDIA PRIVATE LIMITEDPune

Position : Full-Stack Developer (Python + React) Location : Pune Experience : 4-8 years Employment Type : Full-time ...Show moreLast updated: 14 days ago

Promoted

Javascript Developer

Tata Consultancy ServicesPune, Maharashtra, India

TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago

Promoted
New!

Senior Python Developer

Programmers.ioPune, Maharashtra, India

The ideal candidate will have strong expertise in.REST APIs, webhooks, and advanced authentication mechanisms.You should also have practical exposure to. Experience Required : 5-10 Years.Python devel...Show moreLast updated: 8 hours ago

Promoted

Full Stack Developer - Python / Javascript

Vsynergize Outsourcing Pvt. LtdPune

Job description Position Overview : We are seeking a talented and experienced Full Stack Developer with strong Python skills ...Show moreLast updated: 30+ days ago

Promoted

Python Full Stack Developer - React.js / AngularJS

People Prime World WidePune

Job Description : Python Full Stack Developer.Location : Bengaluru, Pune, Mumbai.Experience : 5+ years.About the Role : < / p...Show moreLast updated: 11 days ago

Promoted

Credibl Innovations - Full Stack Developer - Python / Javascript

CREDIBL INNOVATIONS PRIVATE LIMITEDPune

Location : Pune, India (on- site; relocation assistance available) Company : Credibl ESG - AI- powered sustainability & climate- risk SaaS plat...Show moreLast updated: 7 days ago