This job offer is not available in your country.
Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)
AIMLEAPLucknow, IN6 hours ago
Job descriptionDesign, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources. Optimize scraping pipelines for scalability, reliability, and performance. Work with Scrapy and related Python frameworks / libraries for crawler development. Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content. Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance. Implement AI / ML-based solutions in scraping workflows, such as : Using LLMs for content parsing / cleaning. Automating CAPTCHA solving and anti-bot evasion. Improving data matching, deduplication, and entity recognition. Collaborate with data engineers and product teams to ensure scraped data quality and usability. Maintain proper documentation, testing, and CI / CD practices for scraper code. Bachelor's degree in computer science, IT, or related field. Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium). Proficiency in JavaScript for handling browser automation and dynamic sites. Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling). Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX). Experience working with databases (SQL / NoSQL) for storing and processing scraped data. Hands-on experience in AI / ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing. Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments. Strong problem-solving skills for dealing with anti-bot measures and rate limits. Excellent communication and collaboration skills.
Python / JavaScript Developer – Web Scraping - 4 to 7 years
Experience : 4 to 7 Years
Location : Remote
Mode of Engagement : Full-time
No of Positions : 3
Educational Qualifications : Bachelor's degree in Computer Science, Information Technology
Industry : IT / Software Development
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
- Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
- Skilled in JavaScript for web scraping and automation tasks.
- Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
- Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
- Passionate about leveraging advanced technologies to solve complex data challenges
Key Responsibilities
Qualifications
Create a job alert for this search
Web Developer • Lucknow, IN
Related jobs
At BirdChime, we build powerful and easy-to-use Shopify apps that help merchants take control of their time and operations.
Our flagship app, Store Pickup and Delivery Date, is trusted by thousands ...Show moreLast updated: 6 hours ago
- Promoted
Backend Developer / Data Scraping / Kubernetes
Daply | Scaling Digital PublishingLucknow, IN IN ORDER TO BE CONSIDERED FOR THIS ROLE, YOU MUST SUBMIT AN APPLICATION HERE : .Web Scraping / Captcha Control.Show moreLast updated: 7 days ago
- Promoted
UsefulBI Corporation - Full Stack Developer - Python / AngularJS
USEFULBI CORPORATIONLucknow Job Summary : We are seeking a skilled and proactive Full Stack Developer with 6+ years of experience in both backend and frontend development.
The ideal candidate will have str...Show moreLast updated: 30+ days ago
- Promoted
Back End Developer ( GO or Python)
Tilda ResearchLucknow, IN REMOTE OPPORTUNITY - Join a Series A Rocketship headed to Series B Funding.We require each candidate to complete coding exercises in either " GO" or " Python.
Build scalable back-end services using....Show moreLast updated: 30+ days ago
- Promoted
- New!
Shopify Developer- Remote | HTML,CSS,JavaScript,Liquid
BirdChimeLucknow, INRemote
- Promoted
Next.js Web developer
Sweech Ltd.Lucknow, IN We are SW company making system software and application for B2B service.We are working with more than 50+ developer in our company.
South Korea Seoul / Daegu(Remote).We give about 80,000INR Normally ...Show moreLast updated: 7 days ago
- Promoted
Data Engineer - Web Scrapping & Enrichment
Gala IntelligenceLucknow, IN We're looking for an entrepreneurial, passionate, and driven.Navneet Tech Venture situated in.As we're building our technology platform from scratch, you'll have the unique opportunity to shape our...Show moreLast updated: 30+ days ago
- Promoted
Backend Python / AI Engineer
JuiceLabs AILucknow, IN Where creative engineering meets applied AI.At JuiceLabs, we’re building vertical AI-native tools that unlock fresh insights and creative superpowers for our clients in advertising, ecommerce, and ...Show moreLast updated: 7 days ago
- Promoted
Sr. Fullstack engineer
Relevance LabLucknow, IN Design, develop, and maintain our AI Agents platform using Python, FastAPI, React, and TypeScript.Collaborate with cross-functional teams, including product managers, designers, and backend enginee...Show moreLast updated: 30+ days ago
- Promoted
- New!
AI Team Web Developer — React / Tailwind (SaaS)
Visual AIdLucknow, IN Visual AID is a startup pioneering AI-driven cosmetic surgery planning, focusing on developing a bias-free, inclusive Novel Human-Face Medical Model through rigorous research and medical testing.By...Show moreLast updated: 6 hours ago
- Promoted
Senior Web Scraping Engineer
S2T AI - AI-Powered InvestigationsLucknow, IN We are on the lookout for a highly competent, self-motivated.Gather and process raw data at scale (including writing scripts, web scraping, calling APIs).
Able to work independently to complete assi...Show moreLast updated: 30+ days ago
- Promoted
- New!
AI Web Scraping Engineer
S2T AI - AI-Powered InvestigationsLucknow, IN We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show moreLast updated: 6 hours ago
- Promoted
Python Developer
ConfidentialLucknow, India As a Senior Python Developer, you will play a pivotal role in designing, developing, and deploying scalable backend solutions, leveraging cloud technologies and modern frameworks.This position is i...Show moreLast updated: 9 days ago
- Promoted
- New!
Full-Stack Web Developer (React, Vite, Next.js, JS / TS)
AdVran Inc.Lucknow, IN AdVran is a cybersecurity driven software company delivering custom digital solutions, MSP services, and secure, high-performance web applications.
Our team combines cybersecurity engineers, IT spec...Show moreLast updated: 6 hours ago
- Promoted
Calypso Developer
APPIT Software IncLucknow, IN We are looking for Calypso Developer.Total Experience in Years : 5 - 10 years.Top 3 skills which is mandatory.Demonstrable experience (at least 5 years) with Java development, particularly along wi...Show moreLast updated: 6 days ago
- Promoted
AI developer / Support
Dexian IndiaLucknow, IN Understanding of the Basics of Machine Learning.Knowledge of Natural Language Processing (NLP) and NLP Algorithms.Familiarity with Vector Databases.
Experience with Azure Cloud and Deployments.Profi...Show moreLast updated: 30+ days ago
- Promoted
- New!
Senior Web Developer (Next.js, React, Tailwind CSS)- India
Connect Tech+TalentLucknow, IN Senior Web Developer - 6+ years of experience | Specializing in Next.Built modern, responsive, and accessible UI views using Next.
React, and Tailwind CSS, focused on performance and user experience...Show moreLast updated: 6 hours ago
- Promoted
Webflow Developer (Contract)
Josyslucknow, uttar pradesh, in Role Type : Contractor / Consultant.Josys is a fast-growing B2B SaaS startup on a mission to simplify and supercharge IT operations worldwide.
After a stellar launch in Japan and raising $218M in Seri...Show moreLast updated: 4 days ago
- Promoted
Senior Backend Developer
StealthLucknow, IN Fintech Unicorn seeking backend engineers who love building systems that millions trust with their money.Your code directly affects millions of users' financial lives - from seamless payments to sm...Show moreLast updated: 4 days ago