Python/JavaScript Developer – Web Scraping ( 4 to 7 Years)AIMLEAP • hubballi, India
Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)
AIMLEAP • hubballi, India
1 day ago
Job descriptionDesign, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources. Optimize scraping pipelines for scalability, reliability, and performance. Work with Scrapy and related Python frameworks / libraries for crawler development. Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content. Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance. Implement AI / ML-based solutions in scraping workflows, such as : Using LLMs for content parsing / cleaning. Automating CAPTCHA solving and anti-bot evasion. Improving data matching, deduplication, and entity recognition. Collaborate with data engineers and product teams to ensure scraped data quality and usability. Maintain proper documentation, testing, and CI / CD practices for scraper code. Bachelor's degree in computer science, IT, or related field. Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium). Proficiency in JavaScript for handling browser automation and dynamic sites. Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling). Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX). Experience working with databases (SQL / NoSQL) for storing and processing scraped data. Hands-on experience in AI / ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing. Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments. Strong problem-solving skills for dealing with anti-bot measures and rate limits. Excellent communication and collaboration skills.
Python / JavaScript Developer – Web Scraping - 4 to 7 years
Experience : 4 to 7 Years
Location : Remote
Mode of Engagement : Full-time
No of Positions : 3
Educational Qualifications : Bachelor's degree in Computer Science, Information Technology
Industry : IT / Software Development
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
- Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
- Skilled in JavaScript for web scraping and automation tasks.
- Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
- Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
- Passionate about leveraging advanced technologies to solve complex data challenges
Key Responsibilities
Qualifications
Create a job alert for this search
Web Developer • hubballi, India
Related jobs
Fintech Unicorn seeking backend engineers who love building systems that millions trust with their money.Your code directly affects millions of users' financial lives - from seamless payments to sm...Show more
Web Crawling Engineer
Forage AI • Hubli-Dharwad, IN
The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.
Forage AI is a pioneering A...Show more
Last updated: 17 days ago • Promoted
Web Developer
Smart Moves Consultants • Hubli-Dharwad, IN
Design and develop high-performance, responsive web portals using React.Build scalable backend services and APIs with Node.
Integrate and optimize Snowflake for secure data storage, querying, and an...Show more
Last updated: 3 days ago • Promoted
Forward Deployed Engineer
Searchability® • Hubli-Dharwad, IN
Forward Deployed Engineer - AI💻.Remote-based - relocation to Dubai📍.Searchability MENA is working with an innovative AI startup looking for a.
This is a rare chance to get involved with a company ...Show more
Last updated: 11 days ago • Promoted
AI Web Scraping Engineer
S2T AI - AI-Powered Investigations • Hubli-Dharwad, IN
We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more
Last updated: 30+ days ago • Promoted
Javascript Developer
Intellias • Hubli-Dharwad, IN
We are seeking a highly skilled Senior React Native Developer with a solid understanding of React Native, native platform integration, and scalable architecture.
The ideal candidate will have hands-...Show more
Last updated: 11 hours ago • Promoted • New!
Backend Developer
Assima • Hubli-Dharwad, IN
Assima is a worldwide leader in training, assistance and software adoption for Fortune 500 companies.Our patented technology is trusted by 15 of the top 20 banks, major international organizations ...Show more
Last updated: 6 days ago • Promoted
JavaScript / TypeScript Developer - 20414
Turing • Hubli-Dharwad, IN
Turing is looking for experienced Full Stack Developers to build modern solutions that power AI products and evaluation workflows.
LLM behavior with real-world user needs.This is a remote, flexible ...Show more
Last updated: 24 days ago • Promoted
Cloud Native Developer
RED Global • Hubli-Dharwad, IN
Urgent Opportunity- Cloud Native Developer- Contract Opportunity- 100% Remote- 12 months + extension- Full-time- India.Our international IT Consulting client is looking for Cloud Native Developer a...Show more
Last updated: 8 days ago • Promoted
Senior Backend Developer (Remote)
Stealth • Hubli-Dharwad, IN
Remote
Last updated: 30+ days ago • Promoted
React Native Developer. 6 Lakh Users + Big Launch Coming — Want to Build the Core Tech With Us?
FREEDOM ACE INC • Hubli-Dharwad, IN
We’ve already achieved Product-Market Fit.We already have a customer database of 6,00,000+ users.And now we’re building the next phase — a high-scale mobile commerce app built for India.This is not...Show more
Last updated: 11 hours ago • Promoted • New!
Blockchain Developer
StackSmith Consultancy • Hubli-Dharwad, IN
Omara – Blockchain Development Scope (RFP Summary).Omara is building a next-generation carbon credit platform that operates fully on-chain.
The blockchain layer must support : .Tokenisation of already...Show more
Last updated: 13 days ago • Promoted
Frontend Developer React
MarketBeam • Hubli-Dharwad, IN
MarketBeam is a compliant social media management platform built for regulated industries.MarketBeam helps enterprise marketing teams publish and monitor social media content.We are based in Califo...Show more
Last updated: 6 days ago • Promoted
PTC Windchill Developer
Samay Consulting • Hubli-Dharwad, IN
Office timings : 2 : 00 PM—11 : 00 PM.On Behalf of our client we are seeking an experienced PTC Windchill Developer to design, implement, and maintain configurations, customizations and enhancements for...Show more
Last updated: 12 days ago • Promoted
Spring Boot Developer - Fintech Corporation
Huxley • Hubli-Dharwad, IN
We are seeking backend engineers who can design and deliver robust, scalable, and maintainable services.This role involves building new systems or re-engineering existing ones to ensure long-term r...Show more
Last updated: 4 days ago • Promoted
Frontend Developer
GoQuant • Hubli-Dharwad, IN
Front-End Software Engineer (Python / JavaScript).GoQuant Technologies develops innovative solutions that enhance profitability and ease of use for digital asset traders and researchers.Our key produ...Show more
Last updated: 30+ days ago • Promoted
Senior Web Scraping Engineer
Zomunk • Hubli-Dharwad, IN
We're building a product that relies heavily on collecting structured data from a number of known websites.We need someone experienced who can own this part of the system end-to-end; from writing s...Show more
Last updated: 10 days ago • Promoted
Workato Integration Developer
IntraEdge • Hubli-Dharwad, IN
Job Title : Workato Integration Developer.Note : This opportunity is open to •.This role involves designing and building advanced Workato recipes and connectors while leveraging existing integration ...Show more
Last updated: 2 days ago • Promoted
Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)
AIMLEAP • Hubli-Dharwad, IN
Python / JavaScript Developer – Web Scraping - 4 to 7 years.Bachelor's degree in Computer Science, Information Technology.
Strong expertise in web scraping with hands-on experience in large-scale data...Show more
Last updated: 30+ days ago • Promoted