Python/JavaScript Developer – Web Scraping ( 4 to 7 Years)AIMLEAP • kolkata, west bengal, in

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAP • kolkata, west bengal, in

30+ days ago

Job description

Python / JavaScript Developer – Web Scraping - 4 to 7 years

Experience : 4 to 7 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor's degree in Computer Science, Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
Skilled in JavaScript for web scraping and automation tasks.
Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.

Optimize scraping pipelines for scalability, reliability, and performance.

Work with Scrapy and related Python frameworks / libraries for crawler development.

Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.

Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.

Implement AI / ML-based solutions in scraping workflows, such as :

Using LLMs for content parsing / cleaning.

Automating CAPTCHA solving and anti-bot evasion.

Improving data matching, deduplication, and entity recognition.

Collaborate with data engineers and product teams to ensure scraped data quality and usability.

Maintain proper documentation, testing, and CI / CD practices for scraper code.

Qualifications

Bachelor's degree in computer science, IT, or related field.

Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium).

Proficiency in JavaScript for handling browser automation and dynamic sites.

Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).

Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).

Experience working with databases (SQL / NoSQL) for storing and processing scraped data.

Hands-on experience in AI / ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing.

Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.

Strong problem-solving skills for dealing with anti-bot measures and rate limits.

Excellent communication and collaboration skills.

Create a job alert for this search

Web Developer • kolkata, west bengal, in

Related jobs

Javascript Developer

Cognizant • kolkata, west bengal, in

Design, develop, and maintain server-side components and APIs using Node.Create and implement RESTful APIs to facilitate communication between the backend and frontend applications.Integrate and in...Show more

Last updated: 15 days ago • Promoted

Full Stack Engineer - Reactjs, Python

RiDiK (a Subsidiary of CLPS. Nasdaq : CLPS) • kolkata, west bengal, in

ReactJS, TypeScript, Python and AWS.This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to the success of a growing company.If you’...Show more

Last updated: 3 days ago • Promoted

Spring Boot Developer - Fintech Corporation

Huxley • kolkata, west bengal, in

We are seeking backend engineers who can design and deliver robust, scalable, and maintainable services.This role involves building new systems or re-engineering existing ones to ensure long-term r...Show more

Last updated: 3 days ago • Promoted

Founding React Native Developer

InSiteVerse • kolkata, west bengal, in

React Native Mobile App DeveloperEquity Only | Pre-Seed Stage Startup | India Only.We are building a next-generation.Generative AI and advanced ML models. As a part of our founding technical team, y...Show more

Last updated: 4 days ago • Promoted

Endur Developer

Techvy Corp • kolkata, west bengal, in

We are actively looking for an experienced.You will play a critical role in designing, developing, and maintaining solutions on the Openlink Endur platform. This is a high-impact role that requires ...Show more

Last updated: 6 hours ago • Promoted • New!

Back End Developer

EXL • kolkata, west bengal, in

Strong experience in designing and developing RESTful APIs using OpenAPI / Swagger specifications.Proficient in API-first development practices with a focus on scalability, reusability, and clean arc...Show more

Last updated: 15 days ago • Promoted

React Developer

LiteBreeze AB • kolkata, west bengal, in

LiteBreeze, based in Kochi, has been delivering high-level software solutions for over 19 years, primarily serving Nordic clients but also working globally. Specialized in custom software developmen...Show more

Last updated: 30+ days ago • Promoted

Python Developer

VAYUZ Technologies • kolkata, west bengal, in

Develop and maintain scalable backend services using.Build responsive, high-performing front-end interfaces using.Show more

Last updated: 6 hours ago • Promoted • New!

Blockchain Developer

StackSmith Consultancy • kolkata, west bengal, in

Omara – Blockchain Development Scope (RFP Summary).Omara is building a next-generation carbon credit platform that operates fully on-chain. The blockchain layer must support : .Tokenisation of already...Show more

Last updated: 12 days ago • Promoted

Web Developer (Freelance)

Sweet • kolkata, west bengal, in

Sweet is the AI-native business platform built for creators — a business partner that clears the clutter, automates the back-office, and gives creators the freedom to focus on craft, while Sweet gr...Show more

Last updated: 3 days ago • Promoted

Content Developer - Payment systems

Talentgigs • kolkata, west bengal, in

Role : Content Developer - Payment systems.Proven experience in content writing for the FinTech industry, with direct exposure to International Payments, SWIFT, or complex financial services messagi...Show more

Last updated: 6 hours ago • Promoted • New!

website developer

Lawshield Technologies Private Limited • kolkata, west bengal, in

India LawShield is a technology-driven platform redefining legal assistance in India by combining AI-powered automation with human legal expertise. Founded by professionals from Artificial Intellige...Show more

Last updated: 6 hours ago • Promoted • New!

Java Fullstack Developer

Infosys • kolkata, west bengal, in

Looking for candidates with minimum 5 years of experience in Java Fullstack (Java Springboot and Angular) in Bangalore location. Immediate Joiners will be preferred.Minimum 5 years of experience in ...Show more

Last updated: 15 days ago • Promoted

Senior Java Software Engineer

ACL Digital • kolkata, west bengal, in

We are looking Remotly for Senior Java Developer for permanent role.Experience : 5 Years to 8 Years.Notice Period : Immediate(Next Day joiner only). We are seeking a highly skilled and experienced.The...Show more

Last updated: 30+ days ago • Promoted

Shopify Website Developer

JOKRS • kolkata, west bengal, in

We’re Hiring — Contractual Shopify Website Developer.JOKRS (Premium Streetwear for Gen Alpha).We move fast, design bold, and aim to deliver a world-class e-commerce experience.Shopify development a...Show more

Last updated: 6 hours ago • Promoted • New!

MEAN Stack Developer

Yakuza E-Vehicles • kolkata, west bengal, in

Experience Required : 3–4 Years.Are you a passionate full-stack developer with hands-on experience in the.Develop, test, and deploy full-stack web applications using the. Collaborate with UI / UX desig...Show more

Last updated: 6 hours ago • Promoted • New!

Web Scraper Expert (Part-Time / Freelance) – L4RG

Lead For Revenue Generation • kolkata, west bengal, in

Interested candidates can share their CV at : .You will be responsible for developing reliable, scalable, and efficient data-scraping solutions that support our digital marketing, research, and autom...Show more

Last updated: 6 hours ago • Promoted • New!

React Native Developer

ExpansionJS • kolkata, west bengal, in

ExpansionJS is the driving force behind SubcontractorHub, a leading SAAS platform that revolutionizes subcontractor management. We thrive on innovation, pushing boundaries, and building cutting-edge...Show more

Last updated: 1 day ago • Promoted