Talent.com
Python Web Scraping Engineer – Automation (3 to 10 yrs)
Python Web Scraping Engineer – Automation (3 to 10 yrs)AIMLEAP • ajit, India
Python Web Scraping Engineer – Automation (3 to 10 yrs)

Python Web Scraping Engineer – Automation (3 to 10 yrs)

AIMLEAP • ajit, India
4 days ago
Job description

Python Web Scraping Engineer – Advanced Automation (WFH)

Experience : 3–10 Years

Location : Remote (Work from Home)

Mode of Engagement : Full-time

No of Positions : 8

Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field

Industry : IT / Software Services / Data & AI

Notice Period : Immediate Joiners Preferred

What We Are Looking For

  • Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
  • Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
  • Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
  • Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
  • Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.

Responsibilities

  • Develop and maintain high-scale automated scraping workflows for dynamic and protected websites.
  • Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering.
  • Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms.
  • Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling.
  • Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets.
  • Qualifications

  • 3–10 years of experience in Python-based web scraping and automation .
  • Strong experience in Selenium, Playwright, Puppeteer , and browser automation.
  • Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy .
  • Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies.
  • Understanding of SQL / NoSQL databases for structured data storage.
  • Experience working with AWS / GCP / Azure is a plus.
  • Strong debugging, analytical, and problem-solving skills.
  • Create a job alert for this search

    Automation Engineer • ajit, India

    Related jobs
    Python Developer (AWS & Infrastructure)

    Python Developer (AWS & Infrastructure)

    Yoda Tech • ajit, India
    Python Developer (With AWS & Infrastructure experience).We are looking for a Python Developer with strong experience in designing and implementing scalable, secure applications in complex cloud env...Show more
    Last updated: 1 day ago • Promoted
    Freelancer 100% Remote-Sr Python Developer / Scripting

    Freelancer 100% Remote-Sr Python Developer / Scripting

    Vaikun Technologies Pvt ltd • ajit, India
    Remote
    Please note that the salary offered is 2 lakhs INR after the TDS.So, please apply only if this is fine.We are re-posting this due customer budget issues. Strong data structures, design, algorithms, ...Show more
    Last updated: 19 hours ago • Promoted • New!
    Senior Software Engineer (Python, React)

    Senior Software Engineer (Python, React)

    Better Software • ajit, India
    Better Software is a product development studio that partners with entrepreneurs and enterprises to launch new initiatives. Many of these products evolve into large-scale systems, and we act as long...Show more
    Last updated: 30+ days ago • Promoted
    Senior AWS Cloud Engineer

    Senior AWS Cloud Engineer

    9NEXUS • ajit, India
    Job Title : Senior Cloud Engineer (Data Platform).Seeking an experienced Cloud Engineer to support Data Platform function by enabling feature teams with secure, scalable, and reusable AWS infrastruc...Show more
    Last updated: 1 day ago • Promoted
    Lead – Robotics & STEM Curriculum

    Lead – Robotics & STEM Curriculum

    Evobi Automations Pvt Ltd • ajit, India
    Bengaluru, brings over 12 years of expertise in technology and manufacturing.This is a full-time on-site role for a Robotics Curriculum Lead ( in Yudu Robotics Division ) based at our Bengaluru of...Show more
    Last updated: 13 hours ago • Promoted • New!
    Senior Software Engineer (Full Stack)

    Senior Software Engineer (Full Stack)

    BigStep Technologies • ajit, India
    We’re looking for a Full Stack Engineer with.The ideal candidate should be highly skilled in.NoSQL databases, microservices architecture, and cloud-native development. AI-driven tools or AI-based ed...Show more
    Last updated: 2 days ago • Promoted
    Software Engineer (React, Python, Node.js) – US-Based Company | Remote

    Software Engineer (React, Python, Node.js) – US-Based Company | Remote

    Seventh Contact Hiring Solutions • ajit, India
    Remote
    Developer (3–6 Years) | Remote.We are seeking a talented Full-Stack Developer with strong expertise in React, Python, and Node. Windows-based desktop application for medical research.You will work o...Show more
    Last updated: 1 day ago • Promoted
    Python AI Developer

    Python AI Developer

    Darsan Technologies, Inc • ajit, India
    We are looking for a skilled Python AI Developer with solid experience in building, deploying, and maintaining AI-driven applications. You will work from prototyping to production deployment using m...Show more
    Last updated: 1 day ago • Promoted
    Amazon Redshift

    Amazon Redshift

    Vidhema Technologies • ajit, India
    Notice Period : Immediate Joiners Preferred.We are looking for an experienced.Amazon Redshift Developer to lead the design, setup, and management of new Redshift projects from the ground up.The idea...Show more
    Last updated: 13 hours ago • Promoted • New!
    DevOps-Github-Tech-Architect ( Full-time at a Fortune 500 tech MNC)

    DevOps-Github-Tech-Architect ( Full-time at a Fortune 500 tech MNC)

    HARP • ajit, India
    Plan, execute, and monitor end-to-end migrations from Azure DevOps to GitHub using GitHub Enterprise Importer (GEI) or equivalent tools. Validate migration logs post-migration to ensure completeness...Show more
    Last updated: 1 day ago • Promoted
    L1 DevOps professional

    L1 DevOps professional

    Grassdoor • ajit, India
    L1 DevOps professional (Night Shift, Rotational).Remote (Night Shift, Rotational).At Grassdoor Logistics Technologies, we are redefining the landscape of Cannabis commerce by.Unified Operations Cen...Show more
    Last updated: 1 day ago • Promoted
    Dotnet with Angular + AWS (Services) + Python( Full-time at a Fortune 500 tech MNC)

    Dotnet with Angular + AWS (Services) + Python( Full-time at a Fortune 500 tech MNC)

    HARP • ajit, India
    Developing web applications using class based Python objectBuilding user interfaces using Angular to create and implement user interface components. Working with AWS services like EC2 ECS SNSS3Dynam...Show more
    Last updated: 1 day ago • Promoted
    Backend / Fullstack Engineer (PHP • Drupal • Python)

    Backend / Fullstack Engineer (PHP • Drupal • Python)

    Pulp Strategy • ajit, India
    Pulp Strategy develops robust platforms, CMS ecosystems, and automated backend systems powering enterprise-level performance. With a focus on productized workflows and digital acceleration, we are s...Show more
    Last updated: 13 hours ago • Promoted • New!
    AI Software Engineer

    AI Software Engineer

    Ai Jobs • ajit, India
    This role is ideal for professionals passionate about artificial intelligence, machine learning, and software engineering who want to make a tangible impact on real-world applications.As an AI Soft...Show more
    Last updated: 1 day ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Plumloom • ajit, India
    Role - Full Stack Developer L4.We’re building an AI evaluation platform that’s becoming indispensable for AI teams.As a Full Stack Developer (backend focused), you’ll craft intuitive, high-performa...Show more
    Last updated: 2 days ago • Promoted
    Full Stack Tech Lead- Contract

    Full Stack Tech Lead- Contract

    Gravity Infosolutions, Inc. • ajit, India
    Job description for Tech Lead Full Stack : .Conducts code review, contributes writing code, proficient in Java + at least one language between Typescript and Python. Basic understanding of Infrastruct...Show more
    Last updated: 2 days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Adapts • ajit, India
    Full-Stack Engineer (Remote) — Join Adapts.Adapts is transforming software maintenance by converting legacy code into comprehensive developer documentation, including specs and diagrams.This innova...Show more
    Last updated: 1 day ago • Promoted
    Lead Python Developer_ Exp : 8+ Years

    Lead Python Developer_ Exp : 8+ Years

    Atyeti Inc • ajit, India
    Strong hands-on experience in Python.Strong experience on Django / Flask framework development.Solid understanding of OOP, REST APIs, and microservices architecture. Exposure to SQL / NoSQL databases f...Show more
    Last updated: 1 day ago • Promoted