Talent.com
Python Web Scraping Engineer – Automation (3 to 10 yrs)
Python Web Scraping Engineer – Automation (3 to 10 yrs)AIMLEAP • Thrissur, IN
No longer accepting applications
Python Web Scraping Engineer – Automation (3 to 10 yrs)

Python Web Scraping Engineer – Automation (3 to 10 yrs)

AIMLEAP • Thrissur, IN
5 days ago
Job description

Python Web Scraping Engineer – Advanced Automation (WFH)

Experience : 3–10 Years

Location : Remote (Work from Home)

Mode of Engagement : Full-time

No of Positions : 8

Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field

Industry : IT / Software Services / Data & AI

Notice Period : Immediate Joiners Preferred

What We Are Looking For

  • Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
  • Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
  • Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
  • Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
  • Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.

Responsibilities

  • Develop and maintain high-scale automated scraping workflows for dynamic and protected websites.
  • Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering.
  • Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms.
  • Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling.
  • Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets.
  • Qualifications

  • 3–10 years of experience in Python-based web scraping and automation .
  • Strong experience in Selenium, Playwright, Puppeteer , and browser automation.
  • Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy .
  • Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies.
  • Understanding of SQL / NoSQL databases for structured data storage.
  • Experience working with AWS / GCP / Azure is a plus.
  • Strong debugging, analytical, and problem-solving skills.
  • Create a job alert for this search

    Automation Engineer • Thrissur, IN

    Related jobs
    Automation Engineer / Devops Engineer

    Automation Engineer / Devops Engineer

    DigiHelic Solutions Pvt. Ltd. • Thrissur, IN
    The Automation Engineer will be responsible for designing, developing, and executing automated workflows to support the migration of source control systems from Perforce to GitHub.This role involve...Show more
    Last updated: 4 hours ago • Promoted • New!
    Agentic & AI Tech Ops Engineer

    Agentic & AI Tech Ops Engineer

    Insight Global • Thrissur, IN
    Agentic & AI Tech Ops Engineer.Agentic & AI Tech Ops Engineer.AI and Agentic AI systems in production.You will manage deployments, monitor performance, troubleshoot issues, and implement best pract...Show more
    Last updated: 6 days ago • Promoted
    Backend Python Engineer

    Backend Python Engineer

    Turing • Thrissur, IN
    We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and ...Show more
    Last updated: 1 day ago • Promoted
    Senior / Lead / Principal SDET - Python automation(Storage)

    Senior / Lead / Principal SDET - Python automation(Storage)

    DDN • Thrissur, IN
    This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a globa...Show more
    Last updated: 16 days ago • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    Luxoft • Thrissur, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 26 days ago • Promoted
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    Syntasa • Thrissur, IN
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportuni...Show more
    Last updated: 30+ days ago • Promoted
    Python Coder

    Python Coder

    Aceolution • Thrissur, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 1 day ago • Promoted
    Forward Deployed Engineer

    Forward Deployed Engineer

    Searchability® • Thrissur, IN
    Forward Deployed Engineer - AI💻.Remote-based - relocation to Dubai📍.Searchability MENA is working with an innovative AI startup looking for a. This is a rare chance to get involved with a company ...Show more
    Last updated: 16 days ago • Promoted
    AI Data Engineer

    AI Data Engineer

    Turing • Thrissur, IN
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 1 day ago • Promoted
    Azure AI Foundry Developer

    Azure AI Foundry Developer

    Undocked • Thrissur, IN
    At Undocked, we help companies excel in e-commerce by delivering bespoke optimizations and cutting-edge analytics.Our experiences in retail and supply chain product strategy, technology, and operat...Show more
    Last updated: 30+ days ago • Promoted
    Tech Lead (Full Stack | React + Python)

    Tech Lead (Full Stack | React + Python)

    Aumne AI • Thrissur, IN
    Aumne AI is building next-gen AI systems for customer experience.We’re looking for a frontend-strong Tech Lead who values clean design, simple architecture, and fast execution.Lead UI architecture ...Show more
    Last updated: 4 hours ago • Promoted • New!
    Python Web Scraping Engineer – Automation (3 to 10 yrs)

    Python Web Scraping Engineer – Automation (3 to 10 yrs)

    AIMLEAP • Thrissur, Kerala, India
    Python Web Scraping Engineer – Advanced Automation (WFH) Experience : 3–10 Years Location : Remote (Work from Home) Mode of Engagement : Full-time No of Positions : 8 Educational Qualification : B...Show more
    Last updated: 5 days ago • Promoted
    Web Developer

    Web Developer

    Best NanoTech • Thrissur, IN
    The ideal candidate is a creative problem solver who will work in coordination with cross-functional teams to design, develop, and maintain our next generation websites and web tools.You must be co...Show more
    Last updated: 4 hours ago • Promoted • New!
    Python Automation Engineer

    Python Automation Engineer

    XpertDox India Pvt Ltd • Thrissur, IN
    Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM). Familiarity with Windows and Linux fundam...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Thrissur, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    AI Platform Engineer

    AI Platform Engineer

    BayOne Solutions • Thrissur, IN
    We are seeking a highly skilled.In this role, you will work on advanced AI systems including.Retrieval-Augmented Generation (RAG). Model Context Protocol (MCP) tools.OpenWebUI or custom-built soluti...Show more
    Last updated: 20 days ago • Promoted
    Python Automation Developer - PAN India

    Python Automation Developer - PAN India

    Concentrix • Thrissur, IN
    Looking for Python Expertise with minimum 6+ years of experience with having below must have skills : .Experience in automating business processes using Python. Integrate bots with databases (SQL, Pos...Show more
    Last updated: 9 days ago • Promoted
    Engineer, GitHub Copilot

    Engineer, GitHub Copilot

    Asteya Technologies • Thrissur, IN
    Generative AI & Tool Expertise, including MCP usage and Agentic Orchestration.Expert-level knowledge of GitHub Copilot and Amazon Q features, including Copilot Chat agents and Amazon Q’s / dev comma...Show more
    Last updated: 20 days ago • Promoted