Talent.com
Python/JavaScript Developer – Web Scraping ( 4 to 7 Years)
Python/JavaScript Developer – Web Scraping ( 4 to 7 Years)AIMLEAP • bhubaneswar, orissa, in
Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAP • bhubaneswar, orissa, in
30+ days ago
Job description

Python / JavaScript Developer – Web Scraping - 4 to 7 years

Experience : 4 to 7 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor's degree in Computer Science, Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
  • Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
  • Skilled in JavaScript for web scraping and automation tasks.
  • Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
  • Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
  • Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

  • Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.
  • Optimize scraping pipelines for scalability, reliability, and performance.
  • Work with Scrapy and related Python frameworks / libraries for crawler development.
  • Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.
  • Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.
  • Implement AI / ML-based solutions in scraping workflows, such as :
  • Using LLMs for content parsing / cleaning.
  • Automating CAPTCHA solving and anti-bot evasion.
  • Improving data matching, deduplication, and entity recognition.
  • Collaborate with data engineers and product teams to ensure scraped data quality and usability.
  • Maintain proper documentation, testing, and CI / CD practices for scraper code.
  • Qualifications

  • Bachelor's degree in computer science, IT, or related field.
  • Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium).
  • Proficiency in JavaScript for handling browser automation and dynamic sites.
  • Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).
  • Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).
  • Experience working with databases (SQL / NoSQL) for storing and processing scraped data.
  • Hands-on experience in AI / ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing.
  • Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.
  • Strong problem-solving skills for dealing with anti-bot measures and rate limits.
  • Excellent communication and collaboration skills.
  • Create a job alert for this search

    Web Developer • bhubaneswar, orissa, in

    Related jobs
    Spring Boot Developer - Fintech Corporation

    Spring Boot Developer - Fintech Corporation

    Huxley • bhubaneswar, orissa, in
    We are seeking backend engineers who can design and deliver robust, scalable, and maintainable services.This role involves building new systems or re-engineering existing ones to ensure long-term r...Show more
    Last updated: 3 days ago • Promoted
    Full Stack Developer

    Full Stack Developer

    WeConnect • bhubaneswar, orissa, in
    We are seeking an experienced Full-Stack Developer to join a dynamic and globally recognized academic institution on a 9-month contractual engagement. The role involves developing and maintaining we...Show more
    Last updated: 3 days ago • Promoted
    Founding React Native Developer

    Founding React Native Developer

    InSiteVerse • bhubaneswar, orissa, in
    React Native Mobile App DeveloperEquity Only | Pre-Seed Stage Startup | India Only.We are building a next-generation.Generative AI and advanced ML models. As a part of our founding technical team, y...Show more
    Last updated: 4 days ago • Promoted
    Content Developer - Payment systems

    Content Developer - Payment systems

    Talentgigs • bhubaneswar, orissa, in
    Role : Content Developer - Payment systems.Proven experience in content writing for the FinTech industry, with direct exposure to International Payments, SWIFT, or complex financial services messagi...Show more
    Last updated: 7 hours ago • Promoted • New!
    Frontend Developer

    Frontend Developer

    GoQuant • bhubaneswar, orissa, in
    Front-End Software Engineer (Python / JavaScript).GoQuant Technologies develops innovative solutions that enhance profitability and ease of use for digital asset traders and researchers.Our key produ...Show more
    Last updated: 7 days ago • Promoted
    Shopify Website Developer

    Shopify Website Developer

    JOKRS • bhubaneswar, orissa, in
    We’re Hiring — Contractual Shopify Website Developer.JOKRS (Premium Streetwear for Gen Alpha).We move fast, design bold, and aim to deliver a world-class e-commerce experience.Shopify development a...Show more
    Last updated: 7 hours ago • Promoted • New!
    Web Developer (Freelance)

    Web Developer (Freelance)

    Sweet • bhubaneswar, orissa, in
    Sweet is the AI-native business platform built for creators — a business partner that clears the clutter, automates the back-office, and gives creators the freedom to focus on craft, while Sweet gr...Show more
    Last updated: 3 days ago • Promoted
    Endur Developer

    Endur Developer

    Techvy Corp • bhubaneswar, orissa, in
    We are actively looking for an experienced.You will play a critical role in designing, developing, and maintaining solutions on the Openlink Endur platform. This is a high-impact role that requires ...Show more
    Last updated: 7 hours ago • Promoted • New!
    Web Scraper Expert (Part-Time / Freelance) – L4RG

    Web Scraper Expert (Part-Time / Freelance) – L4RG

    Lead For Revenue Generation • bhubaneswar, orissa, in
    Interested candidates can share their CV at : .You will be responsible for developing reliable, scalable, and efficient data-scraping solutions that support our digital marketing, research, and autom...Show more
    Last updated: 7 hours ago • Promoted • New!
    React Developer

    React Developer

    LiteBreeze AB • bhubaneswar, orissa, in
    LiteBreeze, based in Kochi, has been delivering high-level software solutions for over 19 years, primarily serving Nordic clients but also working globally. Specialized in custom software developmen...Show more
    Last updated: 30+ days ago • Promoted
    Javascript Developer

    Javascript Developer

    Cognizant • bhubaneswar, orissa, in
    Design, develop, and maintain server-side components and APIs using Node.Create and implement RESTful APIs to facilitate communication between the backend and frontend applications.Integrate and in...Show more
    Last updated: 15 days ago • Promoted
    MEAN Stack Developer

    MEAN Stack Developer

    Yakuza E-Vehicles • bhubaneswar, orissa, in
    Experience Required : 3–4 Years.Are you a passionate full-stack developer with hands-on experience in the.Develop, test, and deploy full-stack web applications using the. Collaborate with UI / UX desig...Show more
    Last updated: 7 hours ago • Promoted • New!
    Spring Boot Developer

    Spring Boot Developer

    Revolut • bhubaneswar, orissa, in
    We are seeking backend engineers who can design and deliver robust, scalable, and maintainable services.This role involves building new systems or re-engineering existing ones to ensure long-term r...Show more
    Last updated: 3 days ago • Promoted
    Python Developer

    Python Developer

    VAYUZ Technologies • bhubaneswar, orissa, in
    Develop and maintain scalable backend services using.Build responsive, high-performing front-end interfaces using.Show more
    Last updated: 7 hours ago • Promoted • New!
    website developer

    website developer

    Lawshield Technologies Private Limited • bhubaneswar, orissa, in
    India LawShield is a technology-driven platform redefining legal assistance in India by combining AI-powered automation with human legal expertise. Founded by professionals from Artificial Intellige...Show more
    Last updated: 7 hours ago • Promoted • New!
    Senior Go (Golang) Developer

    Senior Go (Golang) Developer

    Ayruz Data Marketing • bhubaneswar, orissa, in
    We are looking for a highly skilled.The candidate will be responsible for building scalable backend systems, APIs, and cloud-native applications while ensuring performance, security, and reliabilit...Show more
    Last updated: 23 days ago • Promoted
    Blockchain Developer

    Blockchain Developer

    StackSmith Consultancy • bhubaneswar, orissa, in
    Omara – Blockchain Development Scope (RFP Summary).Omara is building a next-generation carbon credit platform that operates fully on-chain. The blockchain layer must support : .Tokenisation of already...Show more
    Last updated: 12 days ago • Promoted
    Senior Developer

    Senior Developer

    Tata Consultancy Services • bhubaneswar, orissa, in
    Required Technical Skill Set • •.Desired Competencies (Technical / Behavioral Competency).Ideally should not be more than 3-5). Proficient with Mendix application.Worked in developing Enterprise Apps an...Show more
    Last updated: 30+ days ago • Promoted