Talent.com
Python Web Scraping Engineer – Automation (3 to 10 yrs)
Python Web Scraping Engineer – Automation (3 to 10 yrs)AIMLEAP • ajit, rajasthan, in
Python Web Scraping Engineer – Automation (3 to 10 yrs)

Python Web Scraping Engineer – Automation (3 to 10 yrs)

AIMLEAP • ajit, rajasthan, in
1 day ago
Job description

Python Web Scraping Engineer – Advanced Automation (WFH)

Experience : 3–10 Years

Location : Remote (Work from Home)

Mode of Engagement : Full-time

No of Positions : 8

Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field

Industry : IT / Software Services / Data & AI

Notice Period : Immediate Joiners Preferred

What We Are Looking For

  • Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
  • Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
  • Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
  • Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
  • Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.

Responsibilities

  • Develop and maintain high-scale automated scraping workflows for dynamic and protected websites.
  • Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering.
  • Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms.
  • Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling.
  • Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets.
  • Qualifications

  • 3–10 years of experience in Python-based web scraping and automation .
  • Strong experience in Selenium, Playwright, Puppeteer , and browser automation.
  • Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy .
  • Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies.
  • Understanding of SQL / NoSQL databases for structured data storage.
  • Experience working with AWS / GCP / Azure is a plus.
  • Strong debugging, analytical, and problem-solving skills.
  • Create a job alert for this search

    Automation Engineer • ajit, rajasthan, in

    Related jobs
    Software Engineer

    Software Engineer

    SnapNfit • ajit, rajasthan, in
    SnapNfit is one of India’s fastest-growing “fitness at your doorstep” platforms - building premium tech for personal training, physiotherapy, yoga, and more. We’re expanding our tech team and lookin...Show more
    Last updated: 6 hours ago • Promoted • New!
    Python Developer With Test Driven Development (TDD)

    Python Developer With Test Driven Development (TDD)

    ENCORE IT SOLUTIONS • ajit, rajasthan, in
    Job Description – Senior Python Developer – Service Implementation (TDD) (Contract).Short-term Contract (9 months).Flexible (8 hours / day with 4 hours PST overlap). Candidate should be comfortable wo...Show more
    Last updated: 1 day ago • Promoted
    Senior Python Automation Engineer - Playwright - (Immediate joiners only)

    Senior Python Automation Engineer - Playwright - (Immediate joiners only)

    Innovya Technologies • ajit, rajasthan, in
    Innovya Technologies is a dynamic and growing software consulting firm that drives business automation with cutting-edge solutions. We help businesses quickly realize value from their technology and...Show more
    Last updated: 6 hours ago • Promoted • New!
    Python Developer

    Python Developer

    TekXera • ajit, rajasthan, in
    Senior Python Engineer – Service Implementation.India | Pakistan | Nigeria | Kenya | Egypt | Ghana | Bangladesh | Turkey | Mexico. Full-Time Contract (9 Months, Extendable).San Francisco–based AI re...Show more
    Last updated: 1 day ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Programmers.io • ajit, rajasthan, in
    We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    AideWiser SolTek • ajit, rajasthan, in
    AWS (EC2, Lambda, S3, RDS, DynamoDB, etc.Design, develop, and maintain backend services using.Net Core / MVC and frontend components using React. Build and scale backend systems on AWS cloud infrastru...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Programmers.io • ajit, rajasthan, in
    Job Title : Senior Full Stack Developer (Laravel + Vue).We are seeking highly skilled Senior Full Stack Developers with 7–10 years of experience in Laravel and modern frontend frameworks (Vue.The ca...Show more
    Last updated: 15 days ago • Promoted
    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    Peak Trust Global Real Estate • ajit, rajasthan, in
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: 1 day ago • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Cozzera • ajit, rajasthan, in
    We are looking for an experienced AI / ML Engineer with a strong background in machine learning and deep learning, especially in time-series, sensor, and behavioral data. Strong foundation in ML and d...Show more
    Last updated: 6 hours ago • Promoted • New!
    Web Developer(Node. Js Developer)

    Web Developer(Node. Js Developer)

    SciAstra • ajit, rajasthan, in
    You will work on backend logic, APIs, database management, and system architecture.Develop server-side applications using. Perform database operations using MongoDB / MySQL.Write clean, maintainable, ...Show more
    Last updated: 1 day ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • ajit, rajasthan, in
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred. ML / Data Science with a focus on generative AI, LLMs, or co...Show more
    Last updated: 17 days ago • Promoted
    Python for Machine Learning

    Python for Machine Learning

    People Prime Worldwide • ajit, rajasthan, in
    Our client is a trusted global innovator of IT and business services.They help clients transform through consulting, industry solutions, business process services, digital & IT modernisation and ma...Show more
    Last updated: 3 days ago • Promoted
    Lead Software Engineer

    Lead Software Engineer

    DigiFocal IT Solutions Pvt Ltd • ajit, rajasthan, in
    Lead Software Engineer (TypeScript | React | Node.We are looking only for Immediate Joiner.Design, develop, and deploy scalable web applications using TypeScript, React, and Node.Collaborate with p...Show more
    Last updated: 16 days ago • Promoted
    Senior Python Developer

    Senior Python Developer

    Huptech HR Solutions • ajit, rajasthan, in
    Job Description : - Senior Python Developer.Job Location - Ahmedabad (Remote).Software Development : Write clean, scalable, and efficient Python code to develop software applications.Backend Developm...Show more
    Last updated: 25 days ago • Promoted
    Data Engineering Manager – Web Crawling & Pipeline Architecture ( 7 to 2 yrs)

    Data Engineering Manager – Web Crawling & Pipeline Architecture ( 7 to 2 yrs)

    AIMLEAP • ajit, rajasthan, in
    Data Engineering Manager – Web Crawling & Pipeline Architecture.Tech / MCA / Computer Science / IT .IT / Data / AI / E-commerce / FinTech / Healthcare . Experience working with cloud platforms such ...Show more
    Last updated: 6 hours ago • Promoted • New!
    Junior Software Engineer

    Junior Software Engineer

    Tilda Research • ajit, rajasthan, in
    A passion for building scalable AI agents.Build scalable back-end services using.Optimize graph database queries and models in Neo4j. Collaborate cross-functionally with Product, Engineering, and Cl...Show more
    Last updated: 6 hours ago • Promoted • New!
    Lead Full-Stack + AI Engineer (Founding Team)

    Lead Full-Stack + AI Engineer (Founding Team)

    Grovio AI • ajit, rajasthan, in
    We’re building an autonomous, multi-agent AI OS that plans, executes, and optimizes marketing across modern digital ecosystems. Think : an AI that acts like a virtual CMO — planning, writing, analyz...Show more
    Last updated: 18 hours ago • Promoted • New!
    Full Stack Engineer

    Full Stack Engineer

    Insight Global • ajit, rajasthan, in
    Contract with Insight Global Client.React, React Native, TypeScript.React, React Native, and TypeScript.Deploy containerized solutions using. Ensure high-quality deliverables through.CI / CD pipelines...Show more
    Last updated: 30+ days ago • Promoted