Talent.com
Python/JavaScript Developer – Web Scraping ( 4 to 7 Years)
Python/JavaScript Developer – Web Scraping ( 4 to 7 Years)AIMLEAP • bhopal, madhya pradesh, in
Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAP • bhopal, madhya pradesh, in
30+ days ago
Job description

Python / JavaScript Developer – Web Scraping - 4 to 7 years

Experience : 4 to 7 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor's degree in Computer Science, Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
  • Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
  • Skilled in JavaScript for web scraping and automation tasks.
  • Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
  • Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
  • Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

  • Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.
  • Optimize scraping pipelines for scalability, reliability, and performance.
  • Work with Scrapy and related Python frameworks / libraries for crawler development.
  • Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.
  • Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.
  • Implement AI / ML-based solutions in scraping workflows, such as :
  • Using LLMs for content parsing / cleaning.
  • Automating CAPTCHA solving and anti-bot evasion.
  • Improving data matching, deduplication, and entity recognition.
  • Collaborate with data engineers and product teams to ensure scraped data quality and usability.
  • Maintain proper documentation, testing, and CI / CD practices for scraper code.
  • Qualifications

  • Bachelor's degree in computer science, IT, or related field.
  • Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium).
  • Proficiency in JavaScript for handling browser automation and dynamic sites.
  • Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).
  • Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).
  • Experience working with databases (SQL / NoSQL) for storing and processing scraped data.
  • Hands-on experience in AI / ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing.
  • Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.
  • Strong problem-solving skills for dealing with anti-bot measures and rate limits.
  • Excellent communication and collaboration skills.
  • Create a job alert for this search

    Web Developer • bhopal, madhya pradesh, in

    Related jobs
    NodeJS Developer

    NodeJS Developer

    Tata Consultancy Services • bhopal, madhya pradesh, in
    TCS is Hiring for -NodeJS Developer.Desired Competencies (Technical / Behavioral Competency).Strong proficiency in JavaScript, Typescript and Node. Experience in developing RESTful APIs and web servic...Show more
    Last updated: 5 hours ago • Promoted • New!
    Javascript Developer

    Javascript Developer

    Intellias • bhopal, madhya pradesh, in
    We are seeking a highly skilled Senior React Native Developer with a solid understanding of React Native, native platform integration, and scalable architecture. The ideal candidate will have hands-...Show more
    Last updated: 5 hours ago • Promoted • New!
    Python Developer With Test Driven Development (TDD)

    Python Developer With Test Driven Development (TDD)

    ENCORE IT SOLUTIONS • bhopal, madhya pradesh, in
    Job Description – Senior Python Developer – Service Implementation (TDD) (Contract).Short-term Contract (9 months).Flexible (8 hours / day with 4 hours PST overlap). Candidate should be comfortable wo...Show more
    Last updated: 5 hours ago • Promoted • New!
    React Native Developer. 6 Lakh Users + Big Launch Coming — Want to Build the Core Tech With Us?

    React Native Developer. 6 Lakh Users + Big Launch Coming — Want to Build the Core Tech With Us?

    FREEDOM ACE INC • bhopal, madhya pradesh, in
    We’ve already achieved Product-Market Fit.We already have a customer database of 6,00,000+ users.And now we’re building the next phase — a high-scale mobile commerce app built for India.This is not...Show more
    Last updated: 5 hours ago • Promoted • New!
    Java Developer

    Java Developer

    Crescent Techservices • bhopal, madhya pradesh, in
    Java Spring Boot, J2EE, REST , PL / SQL (Oracle) , Azure, GitLab, Jenkins.Experience of 8+ years working in Backend Development and Microservices using Java Spring Boot, J2EE, REST for implementing p...Show more
    Last updated: 5 hours ago • Promoted • New!
    Javascript Developer

    Javascript Developer

    Meld Techo • bhopal, madhya pradesh, in
    Meld Techo is a leading IT solutions provider specializing in AI-powered software, IoT technologies, and custom software development tailored for diverse industries. Our solutions, including Travel ...Show more
    Last updated: 5 hours ago • Promoted • New!
    Python Developer

    Python Developer

    People Prime Worldwide • bhopal, madhya pradesh, in
    Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA.Founded in 1996, with a revenue of $1. B, with 35,000+ associates worldwide, specializes in digital engin...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Developer (React & Python)

    Full Stack Developer (React & Python)

    Confidential • Bhopal, India
    Confidential (based on experience).Note : This is a requirement for one of Uplers' client - Xpergia).What do you need for this opportunity. Python, TypeScript, Redux, JavaScript, AWS, Azure.We are lo...Show more
    Last updated: 9 days ago • Promoted
    Sr. Python Developer

    Sr. Python Developer

    ToneOpFit • Bhopal, Madhya Pradesh, India
    TONEOPFIT is dedicated to keeping you healthy through an extensive variety of nutritious diet plans and recipes tailored to individual needs and regional preferences. Our team of nutritionists and d...Show more
    Last updated: 8 days ago • Promoted
    Java + AWS Developer

    Java + AWS Developer

    MyRemoteTeam Inc • bhopal, madhya pradesh, in
    MyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent.We empower businesses by providing world-class software engineers, operations suppo...Show more
    Last updated: 5 hours ago • Promoted • New!
    React.js Developer with TypeScript and GCP

    React.js Developer with TypeScript and GCP

    Tata Consultancy Services • bhopal, madhya pradesh, in
    Developer with TypeScript and GCP.Hyderabad, Chennai, Banglore, Pune, Kolkata, Bhubneshwar.Desired Skills - Technical / Behavioral. Proficiency in JavaScript (ES6+) : .Solid understanding of JavaScript...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Web Developer (Full Stack)

    Senior Web Developer (Full Stack)

    Gem3s Technologies Pvt. Ltd. • bhopal, madhya pradesh, in
    We are seeking a highly skilled Full Stack Developer who is proficient in both front-end and back-end development.The ideal candidate will have experience with all stages of software development an...Show more
    Last updated: 5 hours ago • Promoted • New!
    Python Web Scraping Engineer – Automation (3 to 10 yrs)

    Python Web Scraping Engineer – Automation (3 to 10 yrs)

    AIMLEAP • Bhopal, Madhya Pradesh, India
    Python Web Scraping Engineer – Advanced Automation (WFH) Experience : 3–10 Years Location : Remote (Work from Home) Mode of Engagement : Full-time No of Positions : 8 Educational Qualification : B...Show more
    Last updated: 2 hours ago • Promoted • New!
    Javascript Developer

    Javascript Developer

    Talent Corner HR Services Pvt Ltd • bhopal, madhya pradesh, in
    The ideal candidate will be responsible for developing high-quality applications.They will also be responsible for designing and implementing testable and scalable code. Develop quality software and...Show more
    Last updated: 5 hours ago • Promoted • New!
    Full Stack Web Developer

    Full Stack Web Developer

    SME Solutions Advisory LLP • bhopal, madhya pradesh, in
    MSMEs, SMEs, and Startups across India, offering end-to-end handholding to help businesses scale confidently.We specialise in Business Consulting, MSME Incubation Support, Fund-Raising Advisory (De...Show more
    Last updated: 5 hours ago • Promoted • New!
    Python Developer

    Python Developer

    Confidential • Bhopal, India
    ToneOpFit is dedicated to keeping you healthy through a comprehensive range of nutritious diet plans and recipes.Our diverse team of nutritionists and diet experts provides customized meal plans ta...Show more
    Last updated: 28 days ago • Promoted
    Javascript Developer

    Javascript Developer

    Cognizant • bhopal, madhya pradesh, in
    Design, develop, and maintain server-side components and APIs using Node.Create and implement RESTful APIs to facilitate communication between the backend and frontend applications.Integrate and in...Show more
    Last updated: 16 days ago • Promoted
    Sr. Python Developer

    Sr. Python Developer

    Confidential • Bhopal, India
    TONEOPFIT is dedicated to keeping you healthy through an extensive variety of nutritious diet plans and recipes tailored to individual needs and regional preferences. Our team of nutritionists and d...Show more
    Last updated: 6 days ago • Promoted