Talent.com
Python/Javascript Developer – Web Scraping ( 4 To 7 Years)
Python/Javascript Developer – Web Scraping ( 4 To 7 Years)AIMLEAP • Ellore, Republic Of India, IN
No longer accepting applications
Python / Javascript Developer – Web Scraping ( 4 To 7 Years)

Python / Javascript Developer – Web Scraping ( 4 To 7 Years)

AIMLEAP • Ellore, Republic Of India, IN
7 hours ago
Job description

Python / JavaScript Developer – Web Scraping - 4 to 7 years

Experience : 4 to 7 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor's degree in Computer Science, Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
  • Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
  • Skilled in JavaScript for web scraping and automation tasks.
  • Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
  • Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
  • Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

  • Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.
  • Optimize scraping pipelines for scalability, reliability, and performance.
  • Work with Scrapy and related Python frameworks / libraries for crawler development.
  • Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.
  • Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.
  • Implement AI / ML-based solutions in scraping workflows, such as :
  • Using LLMs for content parsing / cleaning.
  • Automating CAPTCHA solving and anti-bot evasion.
  • Improving data matching, deduplication, and entity recognition.
  • Collaborate with data engineers and product teams to ensure scraped data quality and usability.
  • Maintain proper documentation, testing, and CI / CD practices for scraper code.

    • Qualifications

  • Bachelor's degree in computer science, IT, or related field.
  • Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium).
  • Proficiency in JavaScript for handling browser automation and dynamic sites.
  • Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).
  • Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).
  • Experience working with databases (SQL / NoSQL) for storing and processing scraped data.
  • Hands-on experience in AI / ML tools (e.G., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing.
  • Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.
  • Strong problem-solving skills for dealing with anti-bot measures and rate limits.
  • Excellent communication and collaboration skills.
    • Create a job alert for this search

    Web Developer • Ellore, Republic Of India, IN

    Related jobs
    Human Resources Generalist

    Human Resources Generalist

    Confidential • Naidupeta, India
    Job purpose : Birla Carbon Andhra Pradesh Limited is setting up greenfield projects of 240 KTPA at Naidupeta, Nellore Dist. Project is planned to complete in 2 phases 120 KTPA each.We are looking for...Show more
    Last updated: 19 days ago • Promoted
    Information Technology Manager

    Information Technology Manager

    Confidential • Naidupeta, India
    Support to implement a broad range of technologies that enhance productivity and collaboration.This includes End User Infrastructure (Desktops, Laptops, Mobile Phones, iPad, Printers, Scanners, MS ...Show more
    Last updated: 13 hours ago • Promoted • New!
    Information Technology Manager

    Information Technology Manager

    Birla Carbon • Naidupeta, Andhra Pradesh, India
    Support to implement a broad range of technologies that enhance productivity and collaboration.This includes End User Infrastructure (Desktops, Laptops, Mobile Phones, iPad, Printers, Scanners, MS ...Show more
    Last updated: 14 hours ago • Promoted • New!
    Human Resources Generalist

    Human Resources Generalist

    Birla Carbon • Naidupeta, Andhra Pradesh, India
    Job purpose : Birla Carbon Andhra Pradesh Limited is setting up greenfield projects of 240 KTPA at Naidupeta, Nellore Dist. Project is planned to complete in 2 phases 120 KTPA each.We are looking for...Show more
    Last updated: 23 days ago • Promoted