Talent.com
Python/JavaScript Developer – Web Scraping ( 4 to 7 Years)
Python/JavaScript Developer – Web Scraping ( 4 to 7 Years)AIMLEAP • davanagere, karnataka, in
No longer accepting applications
Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAP • davanagere, karnataka, in
30+ days ago
Job description

Python / JavaScript Developer – Web Scraping - 4 to 7 years

Experience : 4 to 7 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor's degree in Computer Science, Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
  • Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
  • Skilled in JavaScript for web scraping and automation tasks.
  • Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
  • Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
  • Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

  • Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.
  • Optimize scraping pipelines for scalability, reliability, and performance.
  • Work with Scrapy and related Python frameworks / libraries for crawler development.
  • Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.
  • Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.
  • Implement AI / ML-based solutions in scraping workflows, such as :
  • Using LLMs for content parsing / cleaning.
  • Automating CAPTCHA solving and anti-bot evasion.
  • Improving data matching, deduplication, and entity recognition.
  • Collaborate with data engineers and product teams to ensure scraped data quality and usability.
  • Maintain proper documentation, testing, and CI / CD practices for scraper code.
  • Qualifications

  • Bachelor's degree in computer science, IT, or related field.
  • Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium).
  • Proficiency in JavaScript for handling browser automation and dynamic sites.
  • Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).
  • Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).
  • Experience working with databases (SQL / NoSQL) for storing and processing scraped data.
  • Hands-on experience in AI / ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing.
  • Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.
  • Strong problem-solving skills for dealing with anti-bot measures and rate limits.
  • Excellent communication and collaboration skills.
  • Create a job alert for this search

    Web Developer • davanagere, karnataka, in

    Related jobs
    Web Crawling Engineer

    Web Crawling Engineer

    Forage AI • Davanagere, IN
    The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Forage AI is a pioneering A...Show more
    Last updated: 20 days ago • Promoted
    Frontend Developer

    Frontend Developer

    GoQuant • Davanagere, IN
    Front-End Software Engineer (Python / JavaScript).GoQuant Technologies develops innovative solutions that enhance profitability and ease of use for digital asset traders and researchers.Our key produ...Show more
    Last updated: 30+ days ago • Promoted
    Looker developer

    Looker developer

    RiDiK • Davangere, Karnataka, India
    We are looking for a skilled BI Developer to support a large client in the Healthcare domain.The role will involve enhancing and maintaining reports using Looker / Look ML, developing dimensional dat...Show more
    Last updated: 1 day ago • Promoted
    Python and Node.js Backend developer

    Python and Node.js Backend developer

    RR.T • Davanagere, IN
    Senior Backend Software Engineer.We're looking for entrepreneurial and driven software engineers with.Senior (5+ years of professional experience). Our client is an early-stage, fast-moving team tha...Show more
    Last updated: 3 hours ago • Promoted • New!
    Java Web Developer

    Java Web Developer

    Reqpedia • Davanagere, IN
    Job Title : Full Stack Developer (Java / Python / React).We are looking for an experienced Full Stack Developer with strong hands-on expertise in Java, Python, Spring Boot, React, and SQL, along with pr...Show more
    Last updated: 3 hours ago • Promoted • New!
    6-DEC-25_WalkIN Drive_Bengaluru_Databricks with Python

    6-DEC-25_WalkIN Drive_Bengaluru_Databricks with Python

    Tata Consultancy Services • Davanagere, IN
    Currently, looking for an experienced Individual, worked on.Data-Bricks, Data Lake with Python.Kindly reach-out to me if you inherit these tools. Extensive expertise in designing and implementing da...Show more
    Last updated: 3 hours ago • Promoted • New!
    Python Web Scraping Engineer – Automation (3 to 10 yrs)

    Python Web Scraping Engineer – Automation (3 to 10 yrs)

    AIMLEAP • Davanagere, IN
    Python Web Scraping Engineer – Advanced Automation (WFH).Bachelor’s degree in Computer Science, IT, or related field .IT / Software Services / Data & AI . Strong hands-on experience handling.Seleniu...Show more
    Last updated: 3 days ago • Promoted
    Python Developer

    Python Developer

    Yoda Tech • Davangere, Republic Of India, IN
    Python Developer (With AWS & Infrastructure experience).We are looking for a Python Developer with strong experience in designing and implementing scalable, secure applications in complex cloud env...Show more
    Last updated: 2 hours ago • Promoted • New!
    Back end developer

    Back end developer

    BayOne Solutions • Davangere, Karnataka, India
    About the RoleWe’re looking for a Senior Backend Engineer with deep expertise in Golang, and experience in Ruby, to help us build and scale reliable, high-performance backend systems.As a key membe...Show more
    Last updated: 30+ days ago • Promoted
    Tech Lead - Python / Django

    Tech Lead - Python / Django

    Applore Technologies • Davanagere, IN
    We are building a strong technology backbone that enables seamless digital experiences, impactful.You’ll be part of a dynamic, innovation-driven team working at the intersection of.We’re looking fo...Show more
    Last updated: 3 hours ago • Promoted • New!
    Python Web Scraping Engineer – Automation (3 To 10 Yrs)

    Python Web Scraping Engineer – Automation (3 To 10 Yrs)

    AIMLEAP • Davangere, Republic Of India, IN
    Python Web Scraping Engineer – Advanced Automation (WFH).Bachelor’s degree in Computer Science, IT, or related field.IT / Software Services / Data & AI. Strong hands-on experience handling.Selenium,...Show more
    Last updated: 2 days ago • Promoted
    Javascript Developer

    Javascript Developer

    Cognizant • davanagere, karnataka, in
    Design, develop, and maintain server-side components and APIs using Node.Create and implement RESTful APIs to facilitate communication between the backend and frontend applications.Integrate and in...Show more
    Last updated: 18 days ago • Promoted
    Python Developer With Test Driven Development

    Python Developer With Test Driven Development

    ENCORE IT SOLUTIONS • Davangere, Republic Of India, IN
    Job Description – Senior Python Developer – Service Implementation (TDD) (Contract).Short-term Contract (9 months).Flexible (8 hours / day with 4 hours PST overlap). Candidate should be comfortable wo...Show more
    Last updated: 2 days ago • Promoted
    Senior fullstack engineer

    Senior fullstack engineer

    Black Dog Labs • Davangere, Karnataka, India
    Position : Senior Fullstack Engineer (with Data Engineering Experience) Location : Remote (collaboration across time zones), India or LATAM preferred Engagement Type : Contract (12+ months) Language : ...Show more
    Last updated: 8 hours ago • Promoted • New!
    Senior Web Scraping Engineer

    Senior Web Scraping Engineer

    Zomunk • Davanagere, IN
    We're building a product that relies heavily on collecting structured data from a number of known websites.We need someone experienced who can own this part of the system end-to-end; from writing s...Show more
    Last updated: 13 days ago • Promoted
    Javascript Developer

    Javascript Developer

    Intellias • Davanagere, IN
    We are seeking a highly skilled Senior React Native Developer with a solid understanding of React Native, native platform integration, and scalable architecture. The ideal candidate will have hands-...Show more
    Last updated: 3 days ago • Promoted
    Java Web Developer

    Java Web Developer

    Populace World Solutions • Davanagere, IN
    Position : Java Full Stack Developer.Java 17, Spring Boot, REST API, Angular 8+, Microservices, MySQL.Java 17, Spring Boot, Spring Data JPA, Microservices. Docker, Kubernetes (containerized applicati...Show more
    Last updated: 3 hours ago • Promoted • New!
    Senior Python Developer

    Senior Python Developer

    Huptech HR Solutions • davanagere, karnataka, in
    Job Description : - Senior Python Developer.Job Location - Ahmedabad (Remote).Software Development : Write clean, scalable, and efficient Python code to develop software applications.Backend Developm...Show more
    Last updated: 27 days ago • Promoted