Talent.com
Python Web Scraping Engineer – Automation (3 to 10 yrs)
Python Web Scraping Engineer – Automation (3 to 10 yrs)AIMLEAP • indore, madhya pradesh, in
Python Web Scraping Engineer – Automation (3 to 10 yrs)

Python Web Scraping Engineer – Automation (3 to 10 yrs)

AIMLEAP • indore, madhya pradesh, in
1 day ago
Job description

Python Web Scraping Engineer – Advanced Automation (WFH)

Experience : 3–10 Years

Location : Remote (Work from Home)

Mode of Engagement : Full-time

No of Positions : 8

Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field

Industry : IT / Software Services / Data & AI

Notice Period : Immediate Joiners Preferred

What We Are Looking For

  • Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
  • Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
  • Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
  • Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
  • Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.

Responsibilities

  • Develop and maintain high-scale automated scraping workflows for dynamic and protected websites.
  • Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering.
  • Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms.
  • Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling.
  • Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets.
  • Qualifications

  • 3–10 years of experience in Python-based web scraping and automation .
  • Strong experience in Selenium, Playwright, Puppeteer , and browser automation.
  • Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy .
  • Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies.
  • Understanding of SQL / NoSQL databases for structured data storage.
  • Experience working with AWS / GCP / Azure is a plus.
  • Strong debugging, analytical, and problem-solving skills.
  • Create a job alert for this search

    Automation Engineer • indore, madhya pradesh, in

    Related jobs
    Python Developer - 17852

    Python Developer - 17852

    Turing • Indore, Madhya Pradesh, India
    Role Overview : We’re looking for experienced Python developers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models thi...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    AideWiser SolTek • Indore, Madhya Pradesh, India
    Position : Full Stack Developer Experience : 4+years Location : Remote Mandatory Skills : .AWS (EC2, Lambda, S3, RDS, DynamoDB, etc. Key Responsibilities : Design, develop, and maintain backend servi...Show more
    Last updated: 30+ days ago • Promoted
    Ai data engineer - 17852

    Ai data engineer - 17852

    Turing • Indore, Madhya Pradesh, India
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 1 hour ago • Promoted • New!
    Software Engineer

    Software Engineer

    SnapNfit • indore, madhya pradesh, in
    SnapNfit is one of India’s fastest-growing “fitness at your doorstep” platforms - building premium tech for personal training, physiotherapy, yoga, and more. We’re expanding our tech team and lookin...Show more
    Last updated: 16 hours ago • Promoted • New!
    Backend python engineer - 17852

    Backend python engineer - 17852

    Turing • Indore, Madhya Pradesh, India
    We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and ...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Python Automation Engineer - Playwright - (Immediate joiners only)

    Senior Python Automation Engineer - Playwright - (Immediate joiners only)

    Innovya Technologies • indore, madhya pradesh, in
    Innovya Technologies is a dynamic and growing software consulting firm that drives business automation with cutting-edge solutions. We help businesses quickly realize value from their technology and...Show more
    Last updated: 16 hours ago • Promoted • New!
    Software Engineer (Full Stack) - 17853

    Software Engineer (Full Stack) - 17853

    Turing • Indore, Madhya Pradesh, India
    Role Overview : Turing is seeking experienced Full Stack Software Engineers to help build end-to-end AI-driven applications for US customers — spanning backend services, web frontends, and evaluatio...Show more
    Last updated: 30+ days ago • Promoted
    QA Automation Engineer - Python | Exp 5–8 Years | Full Time - Remote | Shift Timing : 4 PM – 1 AM IST

    QA Automation Engineer - Python | Exp 5–8 Years | Full Time - Remote | Shift Timing : 4 PM – 1 AM IST

    Unicorn Workforce • Indore, India
    Remote
    Position : QA Automation Engineer.Shift Timing : 4 PM – 1 AM IST.Tech (Computer Science or related fields).We are seeking a highly skilled and experienced QA Automation Engineer with 5–8 years of...Show more
    Last updated: 1 hour ago • Promoted • New!
    Python Developer

    Python Developer

    Ccube • Indore, Madhya Pradesh, IN
    Quick Apply
    Position : Python Developer (Mid-Level) Location : Indore (Hybrid) Experience : 3–6 Years About the Role We’re looking for a skilled Python Developer who’s passionate about building ...Show more
    Last updated: 24 days ago
    Junior Software Engineer

    Junior Software Engineer

    Tilda Research • indore, madhya pradesh, in
    A passion for building scalable AI agents.Build scalable back-end services using.Optimize graph database queries and models in Neo4j. Collaborate cross-functionally with Product, Engineering, and Cl...Show more
    Last updated: 16 hours ago • Promoted • New!
    Senior Python Developer

    Senior Python Developer

    Huptech HR Solutions • indore, madhya pradesh, in
    Job Description : - Senior Python Developer.Job Location - Ahmedabad (Remote).Software Development : Write clean, scalable, and efficient Python code to develop software applications.Backend Developm...Show more
    Last updated: 25 days ago • Promoted
    Backend Python Engineer - 17852

    Backend Python Engineer - 17852

    Turing • Indore, Madhya Pradesh, India
    We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and ...Show more
    Last updated: 23 days ago • Promoted
    Full Stack Engineer (Python + JS / TS) - 17853

    Full Stack Engineer (Python + JS / TS) - 17853

    Turing • Indore, Madhya Pradesh, India
    Role Overview : Turing is seeking experienced Full Stack Engineers to help build end-to-end AI-driven applications for US customers — spanning backend services, web frontends, and evaluation tooling...Show more
    Last updated: 23 days ago • Promoted
    Automation Engineer

    Automation Engineer

    Tata Consultancy Services • Indore, Madhya Pradesh, India
    TCS is Hiring for Automation Test Engineer- Selenium Location : Indore Experience : 4-10 Years Notice Period : Immediate to 90 days Desired Competencies- Must have Test Automation, experience in auto...Show more
    Last updated: 30+ days ago • Promoted
    Backend AI / ML Engineer(Strong Python)

    Backend AI / ML Engineer(Strong Python)

    Ccube • Indore, Madhya Pradesh, IN
    Quick Apply
    Position : Backend AI / ML Engineer(Strong Python) Location- Indore, MP (Hybrid , 3 Days a week) Experience : 3–8 years Full-time About the Role : This role transcends tra...Show more
    Last updated: 23 days ago
    Data Engineering Manager – Web Crawling & Pipeline Architecture ( 7 to 2 yrs)

    Data Engineering Manager – Web Crawling & Pipeline Architecture ( 7 to 2 yrs)

    AIMLEAP • Indore, Madhya Pradesh, India
    Data Engineering Manager – Web Crawling & Pipeline Architecture Experience : 7 to 12 Years Location : Remote / Bangalore Engagement : Full-time Positions : 2 Qualification : B.Tech / MCA / Compute...Show more
    Last updated: 11 hours ago • Promoted • New!
    Backend Engineer (Lead) ID45551

    Backend Engineer (Lead) ID45551

    AgileEngine • Indore, MP, in
    Quick Apply
    Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Bes...Show more
    Last updated: 10 days ago
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • indore, madhya pradesh, in
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred. ML / Data Science with a focus on generative AI, LLMs, or co...Show more
    Last updated: 17 days ago • Promoted