Talent.com
This job offer is not available in your country.
Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAPindore, madhya pradesh, in
1 day ago
Job description

Python / JavaScript Developer – Web Scraping - 4 to 7 years

Experience : 4 to 7 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor's degree in Computer Science, Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
  • Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
  • Skilled in JavaScript for web scraping and automation tasks.
  • Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
  • Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
  • Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

  • Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.
  • Optimize scraping pipelines for scalability, reliability, and performance.
  • Work with Scrapy and related Python frameworks / libraries for crawler development.
  • Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.
  • Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.
  • Implement AI / ML-based solutions in scraping workflows, such as :
  • Using LLMs for content parsing / cleaning.
  • Automating CAPTCHA solving and anti-bot evasion.
  • Improving data matching, deduplication, and entity recognition.
  • Collaborate with data engineers and product teams to ensure scraped data quality and usability.
  • Maintain proper documentation, testing, and CI / CD practices for scraper code.
  • Qualifications

  • Bachelor's degree in computer science, IT, or related field.
  • Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium).
  • Proficiency in JavaScript for handling browser automation and dynamic sites.
  • Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).
  • Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).
  • Experience working with databases (SQL / NoSQL) for storing and processing scraped data.
  • Hands-on experience in AI / ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing.
  • Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.
  • Strong problem-solving skills for dealing with anti-bot measures and rate limits.
  • Excellent communication and collaboration skills.
  • Create a job alert for this search

    Web Developer • indore, madhya pradesh, in

    Related jobs
    • Promoted
    Senior Web Developer (Next.js, React, Tailwind CSS)- India

    Senior Web Developer (Next.js, React, Tailwind CSS)- India

    Connect Tech+Talentindore, madhya pradesh, in
    Senior Web Developer - 6+ years of experience | Specializing in Next.Built modern, responsive, and accessible UI views using Next. React, and Tailwind CSS, focused on performance and user experience...Show moreLast updated: 1 day ago
    • Promoted
    Senior Developer

    Senior Developer

    Datacore Technologiesindore, madhya pradesh, in
    Required Skills for Role for Sr.Grafana - at least 6+ Years of experience in administering Grafana and create dashboards and alerts. Requires expertise on skill set for below Create dashboards in Gr...Show moreLast updated: 7 days ago
    • Promoted
    AI developer / Support

    AI developer / Support

    Dexian Indiaindore, madhya pradesh, in
    Understanding of the Basics of Machine Learning.Knowledge of Natural Language Processing (NLP) and NLP Algorithms.Familiarity with Vector Databases. Experience with Azure Cloud and Deployments.Profi...Show moreLast updated: 28 days ago
    • Promoted
    Next JS Developer

    Next JS Developer

    Tata Consultancy Servicesindore, madhya pradesh, in
    Primary Skills : NextJS Framework,ReactJS,Javascript,typescript,Routing,Server Side rendering & Static Site Generation,CSS & Styling,Authentication & Authorization. Performance Optimization, I / CD & D...Show moreLast updated: 9 days ago
    • Promoted
    Backend Developer / Data Scraping / Kubernetes

    Backend Developer / Data Scraping / Kubernetes

    Daply | Scaling Digital Publishingindore, madhya pradesh, in
    IN ORDER TO BE CONSIDERED FOR THIS ROLE, YOU MUST SUBMIT AN APPLICATION HERE : .Web Scraping / Captcha Control.Show moreLast updated: 8 days ago
    • Promoted
    Google Dialogue Flow Developer

    Google Dialogue Flow Developer

    Tata Consultancy ServicesIndore, Madhya Pradesh, India
    Google Dialogue Flow Developer Technical Skills : Hands-on experience with Google Dialogflow ES / CX.Strong understanding of NLP, AI, and machine learning concepts. Proficient in programming languages ...Show moreLast updated: 1 day ago
    • Promoted
    AI Web Scraping Engineer

    AI Web Scraping Engineer

    S2T AI - AI-Powered Investigationsindore, madhya pradesh, in
    We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show moreLast updated: 1 day ago
    • Promoted
    Webflow Developer (Contract)

    Webflow Developer (Contract)

    Josysindore, madhya pradesh, in
    Role Type : Contractor / Consultant.Josys is a fast-growing B2B SaaS startup on a mission to simplify and supercharge IT operations worldwide. After a stellar launch in Japan and raising $218M in Seri...Show moreLast updated: 5 days ago
    • Promoted
    MATHS Teacher ISC syllabus std 6th to 12th Barwaha residential school

    MATHS Teacher ISC syllabus std 6th to 12th Barwaha residential school

    The Palladian HouseBarwah, Madhya Pradesh, India
    Specialized Mathematics teacher ( std 6th to 12th ) in a residential ICSE / ISC school in Barwaha ( Near Indore, Madhya Pradesh ). Best packages to deserving faculty ( residential facilities / food / ...Show moreLast updated: 30+ days ago
    • Promoted
    Full-Stack Web Developer (React, Vite, Next.js, JS / TS)

    Full-Stack Web Developer (React, Vite, Next.js, JS / TS)

    AdVran Inc.indore, madhya pradesh, in
    AdVran is a cybersecurity driven software company delivering custom digital solutions, MSP services, and secure, high-performance web applications. Our team combines cybersecurity engineers, IT spec...Show moreLast updated: 1 day ago
    • Promoted
    Senior Web Scraping Engineer

    Senior Web Scraping Engineer

    S2T AI - AI-Powered Investigationsindore, madhya pradesh, in
    We are on the lookout for a highly competent, self-motivated.Gather and process raw data at scale (including writing scripts, web scraping, calling APIs). Able to work independently to complete assi...Show moreLast updated: 9 days ago
    • Promoted
    Software Developer (JavaScript / TypeScript) - 20414

    Software Developer (JavaScript / TypeScript) - 20414

    TuringIndore, Madhya Pradesh, India
    Turing is looking for experienced Full Stack Developers to build modern solutions that power AI products and evaluation workflows. React / Angular / Vue) to implement features, improve code quality and ...Show moreLast updated: 20 days ago
    • Promoted
    Calypso Developer

    Calypso Developer

    APPIT Software Incindore, madhya pradesh, in
    We are looking for Calypso Developer.Total Experience in Years : 5 - 10 years.Top 3 skills which is mandatory.Demonstrable experience (at least 5 years) with Java development, particularly along wi...Show moreLast updated: 7 days ago
    • Promoted
    Blockchain Developer

    Blockchain Developer

    Confidentielindore, madhya pradesh, in
    We are building robust infrastructure within the Ethereum ecosystem with a focus on Proof of Stake (PoS) and secure private network deployments. We’re looking for a highly motivated self-starter who...Show moreLast updated: 9 days ago
    • Promoted
    Full-Stack Engineer (JavaScript / Typescript) - 20414

    Full-Stack Engineer (JavaScript / Typescript) - 20414

    TuringIndore, Madhya Pradesh, India
    Turing is looking for experienced Full Stack Developers to build modern solutions that power AI products and evaluation workflows. React / Angular / Vue) to implement features, improve code quality and ...Show moreLast updated: 8 days ago
    • Promoted
    Shopify Developer- Remote | HTML,CSS,JavaScript,Liquid

    Shopify Developer- Remote | HTML,CSS,JavaScript,Liquid

    BirdChimeindore, madhya pradesh, in
    Remote
    At BirdChime, we build powerful and easy-to-use Shopify apps that help merchants take control of their time and operations. Our flagship app, Store Pickup and Delivery Date, is trusted by thousands ...Show moreLast updated: 1 day ago
    • Promoted
    AI Team Web Developer — React / Tailwind (SaaS)

    AI Team Web Developer — React / Tailwind (SaaS)

    Visual AIdindore, madhya pradesh, in
    Visual AID is a startup pioneering AI-driven cosmetic surgery planning, focusing on developing a bias-free, inclusive Novel Human-Face Medical Model through rigorous research and medical testing.By...Show moreLast updated: 1 day ago
    • Promoted
    Javascript Fullstack Developer

    Javascript Fullstack Developer

    InfoBeansIndore, Madhya Pradesh, India
    Job Title : JS Fullstack Developer.TypeScript, JavaScript, SQL Server (T-SQL), REST APIs, Linux, Bash, Test / Support experience. Experience Required : 5 – 7 Years.Notice Period : Immediate to 15 days (...Show moreLast updated: 7 days ago