Python/JavaScript Developer – Web Scraping ( 4 to 7 Years)AIMLEAP • davanagere, karnataka, in

No longer accepting applications

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAP • davanagere, karnataka, in

30+ days ago

Job description

Python / JavaScript Developer – Web Scraping - 4 to 7 years

Experience : 4 to 7 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor's degree in Computer Science, Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
Skilled in JavaScript for web scraping and automation tasks.
Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.

Optimize scraping pipelines for scalability, reliability, and performance.

Work with Scrapy and related Python frameworks / libraries for crawler development.

Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.

Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.

Implement AI / ML-based solutions in scraping workflows, such as :

Using LLMs for content parsing / cleaning.

Automating CAPTCHA solving and anti-bot evasion.

Improving data matching, deduplication, and entity recognition.

Collaborate with data engineers and product teams to ensure scraped data quality and usability.

Maintain proper documentation, testing, and CI / CD practices for scraper code.

Qualifications

Bachelor's degree in computer science, IT, or related field.

Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium).

Proficiency in JavaScript for handling browser automation and dynamic sites.

Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).

Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).

Experience working with databases (SQL / NoSQL) for storing and processing scraped data.

Hands-on experience in AI / ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing.

Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.

Strong problem-solving skills for dealing with anti-bot measures and rate limits.

Excellent communication and collaboration skills.

Create a job alert for this search

Web Developer • davanagere, karnataka, in

Related jobs

Python Developer

Huxley • Davanagere, IN

This team oversees the entire advertising technology ecosystem that powers global ad operations.It is a cross-functional, data-driven organization with members distributed across multiple countries...Show more

Last updated: 22 hours ago • Promoted • New!

Freelancer 100% Remote-Sr Python Developer / Scripting

Vaikun Technologies Pvt ltd • Davanagere, IN

Remote

Please note that the salary offered is 2 lakhs INR after the TDS.So, please apply only if this is fine.We are re-posting this due customer budget issues. Strong data structures, design, algorithms, ...Show more

Last updated: 22 hours ago • Promoted • New!

Python Developer

Successive Digital • davanagere, India

Successive Digital, a digital transformation company, offers a comprehensive suite of solutions, including digital strategy, product engineering, CX, Cloud, Data & AI, and Generative AI services.We...Show more

Last updated: 17 hours ago • Promoted • New!

Python Developer

Assets Roster • davangere, India

Assets Roster is a leading and rapidly expanding fixed asset management company, delivering over 12 years of expertise in the domain. Our flagship product, Capexorior, is a comprehensive end-to-end ...Show more

Last updated: 17 hours ago • Promoted • New!

Python Developer

Landmark Group • Davanagere, IN

We are seeking a talented and experienced.The ideal candidate will have 3-5 years of professional experience, a strong proficiency in Python and its frameworks, and a proven track record of designi...Show more

Last updated: 23 days ago • Promoted

Senior Fullstack Python Developer

XSIS • Davangere, Karnataka, India

Senior Fullstack Python Developer (AI & GenAI Focus) Are you a Python expert with a passion for Generative AI? Do you thrive in building scalable architectures from the ground up? XSIS is scaling...Show more

Last updated: 22 hours ago • Promoted • New!

Python Web Scraping Engineer – Automation (3 to 10 yrs)

AIMLEAP • Davanagere, IN

Python Web Scraping Engineer – Advanced Automation (WFH).Bachelor’s degree in Computer Science, IT, or related field .IT / Software Services / Data & AI . Strong hands-on experience handling.Seleniu...Show more

Last updated: 4 days ago • Promoted

Python Developer

IntraEdge • Davanagere, IN

We are building a scalable AWS-based backend application that integrates with CrowdStrike and Palo Alto APIs to process and enforce Host / IP block requests. The application will log and audit each ac...Show more

Last updated: 30+ days ago • Promoted

Python Developer

Tata Consultancy Services • Davanagere, IN

Required Skillset : Python, OOP, Django, Fast API.Core Python Knowledge, which is most important for any framework.Libraries and Frameworks (eg : Django, FastAPI etc). At least basic knowledge of depl...Show more

Last updated: 30+ days ago • Promoted

Python Developer

Embitel Technologies • Davanagere, IN

Job Description : Software Engineer.We are seeking a highly skilled.Python and strong software engineering fundamentals.The ideal candidate will have extensive experience working with object-oriente...Show more

Last updated: 15 days ago • Promoted

Java Web Developer

Reqpedia • davanagere, India

Job Title : Full Stack Developer (Java / Python / React).We are looking for an experienced Full Stack Developer with strong hands-on expertise in Java, Python, Spring Boot, React, and SQL, along with pr...Show more

Last updated: 17 hours ago • Promoted • New!

Python Developer

Webmap Network • Davanagere, IN

Webmap is the no-code way to supercharge your website with AI, boosting engagement and revenue without complexity.Our platform empowers businesses to enhance their online presence effortlessly, dri...Show more

Last updated: 30+ days ago • Promoted

Python Web Scraping Engineer – Automation (3 To 10 Yrs)

AIMLEAP • Davangere, Republic Of India, IN

Python Web Scraping Engineer – Advanced Automation (WFH).Bachelor’s degree in Computer Science, IT, or related field.IT / Software Services / Data & AI. Strong hands-on experience handling.Selenium,...Show more

Last updated: 4 days ago • Promoted

Python Developer

Themesoft Inc. • davanagere, India

Skill set : Java MSB, React JS, Python + Web developer.Mode of interview : 1 round Virtual and 1 F2F.Notice period : Immediate to 15 days. Develop, test, and maintain web applications using Python and ...Show more

Last updated: 17 hours ago • Promoted • New!

Webflow Developer

Uptut • Davangere, Karnataka, India

Job Title : Webflow Developer Employment Type : Full-Time / Permanent Budget : up to ₹35,000 per month Experience : 2+ Years Location : SVH 83 Metro Street • Gurugram, Haryana, India Hey there, Cre...Show more

Last updated: 11 hours ago • Promoted • New!

Javascript Developer

Intellias • Davanagere, IN

We are seeking a highly skilled Senior React Native Developer with a solid understanding of React Native, native platform integration, and scalable architecture. The ideal candidate will have hands-...Show more

Last updated: 4 days ago • Promoted

Senior Python Developer

Huptech HR Solutions • Davanagere, IN

Job Description : - Senior Python Developer.Job Location - Ahmedabad (Remote).Software Development : Write clean, scalable, and efficient Python code to develop software applications.Backend Developm...Show more

Last updated: 28 days ago • Promoted

Full Stack Developer (Java, Spring Boot Python, React)

Reqpedia • davangere, India

Java, Python, Spring Boot, React, SQL, Azure).Design, develop, and maintain backend services using.Build dynamic and responsive user interfaces with. Write efficient queries and manage relational da...Show more

Last updated: 15 hours ago • Promoted • New!