Talent.com
Python/JavaScript Developer – Web Scraping ( 4 to 7 Years)
Python/JavaScript Developer – Web Scraping ( 4 to 7 Years)AIMLEAP • bhopal, madhya pradesh, in
Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAP • bhopal, madhya pradesh, in
30+ days ago
Job description

Python / JavaScript Developer – Web Scraping - 4 to 7 years

Experience : 4 to 7 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor's degree in Computer Science, Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
  • Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
  • Skilled in JavaScript for web scraping and automation tasks.
  • Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
  • Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
  • Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

  • Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.
  • Optimize scraping pipelines for scalability, reliability, and performance.
  • Work with Scrapy and related Python frameworks / libraries for crawler development.
  • Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.
  • Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.
  • Implement AI / ML-based solutions in scraping workflows, such as :
  • Using LLMs for content parsing / cleaning.
  • Automating CAPTCHA solving and anti-bot evasion.
  • Improving data matching, deduplication, and entity recognition.
  • Collaborate with data engineers and product teams to ensure scraped data quality and usability.
  • Maintain proper documentation, testing, and CI / CD practices for scraper code.
  • Qualifications

  • Bachelor's degree in computer science, IT, or related field.
  • Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium).
  • Proficiency in JavaScript for handling browser automation and dynamic sites.
  • Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).
  • Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).
  • Experience working with databases (SQL / NoSQL) for storing and processing scraped data.
  • Hands-on experience in AI / ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing.
  • Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.
  • Strong problem-solving skills for dealing with anti-bot measures and rate limits.
  • Excellent communication and collaboration skills.
  • Create a job alert for this search

    Web Developer • bhopal, madhya pradesh, in

    Related jobs
    NodeJS Developer

    NodeJS Developer

    Tata Consultancy Services • bhopal, madhya pradesh, in
    TCS is Hiring for -NodeJS Developer.Desired Competencies (Technical / Behavioral Competency).Strong proficiency in JavaScript, Typescript and Node. Experience in developing RESTful APIs and web servic...Show more
    Last updated: 1 hour ago • Promoted • New!
    Javascript Developer

    Javascript Developer

    Intellias • bhopal, madhya pradesh, in
    We are seeking a highly skilled Senior React Native Developer with a solid understanding of React Native, native platform integration, and scalable architecture. The ideal candidate will have hands-...Show more
    Last updated: 1 hour ago • Promoted • New!
    Python Developer With Test Driven Development (TDD)

    Python Developer With Test Driven Development (TDD)

    ENCORE IT SOLUTIONS • bhopal, madhya pradesh, in
    Job Description – Senior Python Developer – Service Implementation (TDD) (Contract).Short-term Contract (9 months).Flexible (8 hours / day with 4 hours PST overlap). Candidate should be comfortable wo...Show more
    Last updated: 1 hour ago • Promoted • New!
    React Native Developer. 6 Lakh Users + Big Launch Coming — Want to Build the Core Tech With Us?

    React Native Developer. 6 Lakh Users + Big Launch Coming — Want to Build the Core Tech With Us?

    FREEDOM ACE INC • bhopal, madhya pradesh, in
    We’ve already achieved Product-Market Fit.We already have a customer database of 6,00,000+ users.And now we’re building the next phase — a high-scale mobile commerce app built for India.This is not...Show more
    Last updated: 1 hour ago • Promoted • New!
    Python Web Scraping Engineer – Automation (3 to 10 yrs)

    Python Web Scraping Engineer – Automation (3 to 10 yrs)

    AIMLEAP • bhopal, madhya pradesh, in
    Python Web Scraping Engineer – Advanced Automation (WFH).Bachelor’s degree in Computer Science, IT, or related field .IT / Software Services / Data & AI . Strong hands-on experience handling.Seleniu...Show more
    Last updated: 1 hour ago • Promoted • New!
    Javascript Developer

    Javascript Developer

    Meld Techo • bhopal, madhya pradesh, in
    Meld Techo is a leading IT solutions provider specializing in AI-powered software, IoT technologies, and custom software development tailored for diverse industries. Our solutions, including Travel ...Show more
    Last updated: 1 hour ago • Promoted • New!
    Part-Time Senior Python Backend Developer (3+ years)

    Part-Time Senior Python Backend Developer (3+ years)

    Palcode.ai • bhopal, madhya pradesh, in
    We are building cutting-edge AI products in the.General Contractors, Estimators, and Project Managers manage bids, RFIs, and scope gaps. AI Agents, voice automation, and vision systems.Joining us me...Show more
    Last updated: 1 hour ago • Promoted • New!
    Web Tech Developer

    Web Tech Developer

    Talentgigs • bhopal, madhya pradesh, in
    To Be filled by Hiring Manager.Salary Bracket and variable pay if applicable 8 to 12 LPA (Fixed CTC).Work Location - Hybrid / Work from Office Work From Office - Coimbatore.Total Years of Experienc...Show more
    Last updated: 1 hour ago • Promoted • New!
    Full Stack Developer (React & Python)

    Full Stack Developer (React & Python)

    Confidential • Bhopal, India
    Confidential (based on experience).Note : This is a requirement for one of Uplers' client - Xpergia).What do you need for this opportunity. Python, TypeScript, Redux, JavaScript, AWS, Azure.We are lo...Show more
    Last updated: 9 days ago • Promoted
    Sr. Python Developer

    Sr. Python Developer

    ToneOpFit • Bhopal, Madhya Pradesh, India
    TONEOPFIT is dedicated to keeping you healthy through an extensive variety of nutritious diet plans and recipes tailored to individual needs and regional preferences. Our team of nutritionists and d...Show more
    Last updated: 8 days ago • Promoted
    Senior Web Developer (Full Stack)

    Senior Web Developer (Full Stack)

    Gem3s Technologies Pvt. Ltd. • bhopal, madhya pradesh, in
    We are seeking a highly skilled Full Stack Developer who is proficient in both front-end and back-end development.The ideal candidate will have experience with all stages of software development an...Show more
    Last updated: 1 hour ago • Promoted • New!
    Javascript Developer

    Javascript Developer

    Talent Corner HR Services Pvt Ltd • bhopal, madhya pradesh, in
    The ideal candidate will be responsible for developing high-quality applications.They will also be responsible for designing and implementing testable and scalable code. Develop quality software and...Show more
    Last updated: 1 hour ago • Promoted • New!
    Full Stack Web Developer

    Full Stack Web Developer

    SME Solutions Advisory LLP • bhopal, madhya pradesh, in
    MSMEs, SMEs, and Startups across India, offering end-to-end handholding to help businesses scale confidently.We specialise in Business Consulting, MSME Incubation Support, Fund-Raising Advisory (De...Show more
    Last updated: 1 hour ago • Promoted • New!
    Python Developer

    Python Developer

    Confidential • Bhopal, India
    ToneOpFit is dedicated to keeping you healthy through a comprehensive range of nutritious diet plans and recipes.Our diverse team of nutritionists and diet experts provides customized meal plans ta...Show more
    Last updated: 28 days ago • Promoted
    Javascript Developer

    Javascript Developer

    Cognizant • bhopal, madhya pradesh, in
    Design, develop, and maintain server-side components and APIs using Node.Create and implement RESTful APIs to facilitate communication between the backend and frontend applications.Integrate and in...Show more
    Last updated: 16 days ago • Promoted
    2x (Senior) React.js Developer - Remote - contractor in USD

    2x (Senior) React.js Developer - Remote - contractor in USD

    All European Careers • bhopal, madhya pradesh, in
    Remote
    For an international project in Chennai, we are urgently looking for 2x Full-Remote (Senior) React.Developer with +5 years of experience in Front-End development with strong expertise in React.We a...Show more
    Last updated: 1 hour ago • Promoted • New!
    Sr. Python Developer

    Sr. Python Developer

    Confidential • Bhopal, India
    TONEOPFIT is dedicated to keeping you healthy through an extensive variety of nutritious diet plans and recipes tailored to individual needs and regional preferences. Our team of nutritionists and d...Show more
    Last updated: 6 days ago • Promoted
    Python Developer

    Python Developer

    TekXera • bhopal, madhya pradesh, in
    Senior Python Engineer – Service Implementation.India | Pakistan | Nigeria | Kenya | Egypt | Ghana | Bangladesh | Turkey | Mexico. Full-Time Contract (9 Months, Extendable).San Francisco–based AI re...Show more
    Last updated: 1 hour ago • Promoted • New!