Talent.com
Python Web Scraping Engineer – Automation (3 to 10 yrs)
Python Web Scraping Engineer – Automation (3 to 10 yrs)AIMLEAP • mount, kerala, in
Python Web Scraping Engineer – Automation (3 to 10 yrs)

Python Web Scraping Engineer – Automation (3 to 10 yrs)

AIMLEAP • mount, kerala, in
2 hours ago
Job description

Python Web Scraping Engineer – Advanced Automation (WFH)

Experience : 3–10 Years

Location : Remote (Work from Home)

Mode of Engagement : Full-time

No of Positions : 8

Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field

Industry : IT / Software Services / Data & AI

Notice Period : Immediate Joiners Preferred

What We Are Looking For

  • Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
  • Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
  • Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
  • Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
  • Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.

Responsibilities

  • Develop and maintain high-scale automated scraping workflows for dynamic and protected websites.
  • Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering.
  • Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms.
  • Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling.
  • Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets.
  • Qualifications

  • 3–10 years of experience in Python-based web scraping and automation .
  • Strong experience in Selenium, Playwright, Puppeteer , and browser automation.
  • Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy .
  • Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies.
  • Understanding of SQL / NoSQL databases for structured data storage.
  • Experience working with AWS / GCP / Azure is a plus.
  • Strong debugging, analytical, and problem-solving skills.
  • Create a job alert for this search

    Automation Engineer • mount, kerala, in

    Related jobs
    Web & Product Engineer

    Web & Product Engineer

    Kapable • mount, kerala, in
    Kapable is a leadership transformation platform helping CXOs, founders, and senior professionals from top global companies become better leaders through our “Thinkable, Speakable, Workable” program...Show more
    Last updated: 2 hours ago • Promoted • New!
    Web Tech Developer

    Web Tech Developer

    Talentgigs • mount, kerala, in
    To Be filled by Hiring Manager.Salary Bracket and variable pay if applicable 8 to 12 LPA (Fixed CTC).Work Location - Hybrid / Work from Office Work From Office - Coimbatore.Total Years of Experienc...Show more
    Last updated: 2 hours ago • Promoted • New!
    Python Developer With Test Driven Development (TDD)

    Python Developer With Test Driven Development (TDD)

    ENCORE IT SOLUTIONS • mount, kerala, in
    Job Description – Senior Python Developer – Service Implementation (TDD) (Contract).Short-term Contract (9 months).Flexible (8 hours / day with 4 hours PST overlap). Candidate should be comfortable wo...Show more
    Last updated: 2 hours ago • Promoted • New!
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • mount, kerala, in
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred. ML / Data Science with a focus on generative AI, LLMs, or co...Show more
    Last updated: 16 days ago • Promoted
    SSE– API Automation

    SSE– API Automation

    Staffington Global • Kerala, India, India
    Senior Software Engineer – API Automation.Automation testing, Python, Pandas, Selenium, GEN AI, Dataframeworks.Kochi(Prefer Candidates from Kerala). Immediate joiners or within 15–30 days.Show more
    Last updated: 5 days ago • Promoted
    DevOps Engineer | FINJO I972

    DevOps Engineer | FINJO I972

    Omni Recruit Private Limited • mount, kerala, in
    We are looking for a DevOps Engineer with strong knowledge of GitHub, Docker, UNIX scripting, Python (FastAPI), and VMware. The candidate will be responsible for automating build, deployment, and en...Show more
    Last updated: 2 hours ago • Promoted • New!
    Automation Test Engineer

    Automation Test Engineer

    HappieHire • mount, kerala, in
    Industrial Automation experience – Optional but Preferred.Minimum 4 years of hands-on experience in test automation.Whitefield / HSR Layout / Marathahalli - Bangalore. We are looking for a skilled A...Show more
    Last updated: 2 hours ago • Promoted • New!
    Python Developer

    Python Developer

    People Prime Worldwide • mount, kerala, in
    Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA.Founded in 1996, with a revenue of $1. B, with 35,000+ associates worldwide, specializes in digital engin...Show more
    Last updated: 30+ days ago • Promoted
    Python Developer-AI&Voice Agent Specialist

    Python Developer-AI&Voice Agent Specialist

    Voxtron • mount, kerala, in
    The ideal candidate should be capable of building scalable backend services, integrating AI models, and working on real-time communication systems. Design, develop, and maintain AI-powered chatbots ...Show more
    Last updated: 2 hours ago • Promoted • New!
    Linux Technical Lead

    Linux Technical Lead

    HashRoot • Kerala, India, India
    Job Title : Linux Technical Lead – Server Administration, Web Hosting & Data Center Operations.We are seeking an experienced Linux Technical Lead to oversee and optimize our end-to-end infrastructur...Show more
    Last updated: 6 days ago • Promoted
    Full Stack Engineer | FINJO I971

    Full Stack Engineer | FINJO I971

    Omni Recruit Private Limited • mount, kerala, in
    We are seeking a Full Stack Engineer with strong experience in Python (FastAPI), PostgreSQL, React, GitHub, and Docker.The ideal candidate should have prior experience in a product company and be f...Show more
    Last updated: 2 hours ago • Promoted • New!
    Full Stack Engineer

    Full Stack Engineer

    Insight Global • mount, kerala, in
    Duration : 6 month contract with potential to convert permanent.JS; primary codebase is frontend-heavy.Proficient with Git for source code management. Hands on experience with AWS Elastic Beans, EC2,...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Web Developer

    Full Stack Web Developer

    SME Solutions Advisory LLP • mount, kerala, in
    MSMEs, SMEs, and Startups across India, offering end-to-end handholding to help businesses scale confidently.We specialise in Business Consulting, MSME Incubation Support, Fund-Raising Advisory (De...Show more
    Last updated: 2 hours ago • Promoted • New!
    Technical Cofounder Ruka.live

    Technical Cofounder Ruka.live

    Hotline App Private LTD • Kerala, India, India
    Looking for a Technical Cofounder for Ruka (AI Voice Sales Agent).We’ve built a fully autonomous AI voice-calling sales agent that can do cold calling, lead outreach, and instant inbound follow-ups...Show more
    Last updated: 14 days ago • Promoted
    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    Peak Trust Global Real Estate • mount, kerala, in
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: 2 hours ago • Promoted • New!
    Senior Web Developer (Full Stack)

    Senior Web Developer (Full Stack)

    Gem3s Technologies Pvt. Ltd. • mount, kerala, in
    We are seeking a highly skilled Full Stack Developer who is proficient in both front-end and back-end development.The ideal candidate will have experience with all stages of software development an...Show more
    Last updated: 2 hours ago • Promoted • New!
    Python Developer

    Python Developer

    TekXera • mount, kerala, in
    Senior Python Engineer – Service Implementation.India | Pakistan | Nigeria | Kenya | Egypt | Ghana | Bangladesh | Turkey | Mexico. Full-Time Contract (9 Months, Extendable).San Francisco–based AI re...Show more
    Last updated: 2 hours ago • Promoted • New!
    Part-Time Senior Python Backend Developer (3+ years)

    Part-Time Senior Python Backend Developer (3+ years)

    Palcode.ai • mount, kerala, in
    We are building cutting-edge AI products in the.General Contractors, Estimators, and Project Managers manage bids, RFIs, and scope gaps. AI Agents, voice automation, and vision systems.Joining us me...Show more
    Last updated: 2 hours ago • Promoted • New!