Talent.com
Python Web Scraping Engineer – Automation (3 to 10 yrs)
Python Web Scraping Engineer – Automation (3 to 10 yrs)AIMLEAP • ajit, India
Python Web Scraping Engineer – Automation (3 to 10 yrs)

Python Web Scraping Engineer – Automation (3 to 10 yrs)

AIMLEAP • ajit, India
3 hours ago
Job description

Python Web Scraping Engineer – Advanced Automation (WFH)

Experience : 3–10 Years

Location : Remote (Work from Home)

Mode of Engagement : Full-time

No of Positions : 8

Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field

Industry : IT / Software Services / Data & AI

Notice Period : Immediate Joiners Preferred

What We Are Looking For

  • Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
  • Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
  • Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
  • Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
  • Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.

Responsibilities

  • Develop and maintain high-scale automated scraping workflows for dynamic and protected websites.
  • Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering.
  • Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms.
  • Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling.
  • Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets.
  • Qualifications

  • 3–10 years of experience in Python-based web scraping and automation .
  • Strong experience in Selenium, Playwright, Puppeteer , and browser automation.
  • Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy .
  • Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies.
  • Understanding of SQL / NoSQL databases for structured data storage.
  • Experience working with AWS / GCP / Azure is a plus.
  • Strong debugging, analytical, and problem-solving skills.
  • Create a job alert for this search

    Automation Engineer • ajit, India

    Related jobs
    Automation Test Engineer

    Automation Test Engineer

    HappieHire • ajit, India
    Industrial Automation experience – Optional but Preferred.Minimum 4 years of hands-on experience in test automation.Whitefield / HSR Layout / Marathahalli - Bangalore. We are looking for a skilled A...Show more
    Last updated: 3 hours ago • Promoted • New!
    Software Engineer (Full Stack) - 17853

    Software Engineer (Full Stack) - 17853

    Turing • ajit, India
    Turing is seeking experienced Full Stack Software Engineers to help build end-to-end AI-driven applications for US customers — spanning backend services, web frontends, and evaluation tooling.In th...Show more
    Last updated: 30+ days ago • Promoted
    Web Tech Developer

    Web Tech Developer

    Talentgigs • ajit, India
    To Be filled by Hiring Manager.Salary Bracket and variable pay if applicable 8 to 12 LPA (Fixed CTC).Work Location - Hybrid / Work from Office Work From Office - Coimbatore.Total Years of Experienc...Show more
    Last updated: 3 hours ago • Promoted • New!
    Full Stack Web Developer

    Full Stack Web Developer

    SME Solutions Advisory LLP • ajit, India
    MSMEs, SMEs, and Startups across India, offering end-to-end handholding to help businesses scale confidently.We specialise in Business Consulting, MSME Incubation Support, Fund-Raising Advisory (De...Show more
    Last updated: 3 hours ago • Promoted • New!
    Python Developer - 17852

    Python Developer - 17852

    Turing • ajit, India
    We’re looking for experienced Python developers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • ajit, India
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred. ML / Data Science with a focus on generative AI, LLMs, or co...Show more
    Last updated: 3 hours ago • Promoted • New!
    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    Peak Trust Global Real Estate • ajit, India
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: 3 hours ago • Promoted • New!
    MERN + React Native Developer

    MERN + React Native Developer

    Truxo • Patiala, Punjab, India
    Location : Patiala, Punjab (In-office) Employment Type : Full-Time About FleetPulse FleetPulse is an innovative technology company focused on transforming the logistics and transportation industr...Show more
    Last updated: 22 days ago • Promoted
    Senior Web Developer (Full Stack)

    Senior Web Developer (Full Stack)

    Gem3s Technologies Pvt. Ltd. • ajit, India
    We are seeking a highly skilled Full Stack Developer who is proficient in both front-end and back-end development.The ideal candidate will have experience with all stages of software development an...Show more
    Last updated: 3 hours ago • Promoted • New!
    DevOps Engineer | FINJO I972

    DevOps Engineer | FINJO I972

    Omni Recruit Private Limited • ajit, India
    We are looking for a DevOps Engineer with strong knowledge of GitHub, Docker, UNIX scripting, Python (FastAPI), and VMware. The candidate will be responsible for automating build, deployment, and en...Show more
    Last updated: 3 hours ago • Promoted • New!
    Python Developer - Machine Learning

    Python Developer - Machine Learning

    Talentgigs • ajit, India
    We’re looking for a hands-on Senior ML Engineer (6–10 years) who can : .Lead design and delivery of LLM & Document AI solutions end-to-end. Own ML services in production (APIs, pipelines, monitoring)....Show more
    Last updated: 3 hours ago • Promoted • New!
    Workato Integration Developer

    Workato Integration Developer

    IntraEdge • ajit, India
    Job Title : Workato Integration Developer.Note : This opportunity is open to •.This role involves designing and building advanced Workato recipes and connectors while leveraging existing integration ...Show more
    Last updated: 9 hours ago • Promoted • New!
    Full Stack Engineer | FINJO I971

    Full Stack Engineer | FINJO I971

    Omni Recruit Private Limited • ajit, India
    We are seeking a Full Stack Engineer with strong experience in Python (FastAPI), PostgreSQL, React, GitHub, and Docker.The ideal candidate should have prior experience in a product company and be f...Show more
    Last updated: 3 hours ago • Promoted • New!
    Full Stack Engineer

    Full Stack Engineer

    oanakademi • ajit, India
    We are appointing a fullstack developer with at least 3 years of experience.Full-Stack and Mobile Developer.These roles are highly sought after and often involve building applications that run acro...Show more
    Last updated: 3 hours ago • Promoted • New!
    Software Engineer – Distributed Systems & Modern Web Technologies

    Software Engineer – Distributed Systems & Modern Web Technologies

    Xcitium • ajit, India
    Xcitium is rapidly scaling its engineering team and looking for.This is an opportunity to work on complex, large-scale, high-availability distributed systems while shaping the next generation of Xc...Show more
    Last updated: 3 hours ago • Promoted • New!
    Python Developer

    Python Developer

    People Prime Worldwide • ajit, India
    Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA.Founded in 1996, with a revenue of $1. B, with 35,000+ associates worldwide, specializes in digital engin...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    AideWiser SolTek • ajit, India
    AWS (EC2, Lambda, S3, RDS, DynamoDB, etc.Design, develop, and maintain backend services using.Net Core / MVC and frontend components using React. Build and scale backend systems on AWS cloud infrastru...Show more
    Last updated: 30+ days ago • Promoted
    Web & Product Engineer

    Web & Product Engineer

    Kapable • ajit, India
    Kapable is a leadership transformation platform helping CXOs, founders, and senior professionals from top global companies become better leaders through our “Thinkable, Speakable, Workable” program...Show more
    Last updated: 3 hours ago • Promoted • New!