Talent.com
Python Web Scraping Engineer – Automation (3 to 10 yrs)
Python Web Scraping Engineer – Automation (3 to 10 yrs)AIMLEAP • Hyderabad, IN
Python Web Scraping Engineer – Automation (3 to 10 yrs)

Python Web Scraping Engineer – Automation (3 to 10 yrs)

AIMLEAP • Hyderabad, IN
1 day ago
Job description

Python Web Scraping Engineer – Advanced Automation (WFH)

Experience : 3–10 Years

Location : Remote (Work from Home)

Mode of Engagement : Full-time

No of Positions : 8

Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field

Industry : IT / Software Services / Data & AI

Notice Period : Immediate Joiners Preferred

What We Are Looking For

  • Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
  • Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
  • Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
  • Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
  • Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.

Responsibilities

  • Develop and maintain high-scale automated scraping workflows for dynamic and protected websites.
  • Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering.
  • Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms.
  • Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling.
  • Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets.
  • Qualifications

  • 3–10 years of experience in Python-based web scraping and automation .
  • Strong experience in Selenium, Playwright, Puppeteer , and browser automation.
  • Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy .
  • Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies.
  • Understanding of SQL / NoSQL databases for structured data storage.
  • Experience working with AWS / GCP / Azure is a plus.
  • Strong debugging, analytical, and problem-solving skills.
  • Create a job alert for this search

    Automation Engineer • Hyderabad, IN

    Related jobs
    Senior Python Backend Developer (AI, Cloud & CI / CD)Agentic AI Engineer

    Senior Python Backend Developer (AI, Cloud & CI / CD)Agentic AI Engineer

    GenNow.AI • Hyderabad, Telangana, India
    Senior Python Backend Developer (4–8 years of experience).Python (FastAPI, Flask, or Django).Deploy and manage backend services on. GitHub Actions, GitLab CI, or Jenkins.Containerize applications us...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Systems Automation Engineer

    Cloud Systems Automation Engineer

    Creyente Infotech • Hyderabad, Republic Of India, IN
    We’re hiring a Cloud Infrastructure & SRE Engineer who doesn’t just manage systems — but engineers reliability into everything. At Creyente Infotech, we’re building real-time platforms that power in...Show more
    Last updated: 2 days ago • Promoted
    FinOps Cloud Automation Engineer(Python)

    FinOps Cloud Automation Engineer(Python)

    CirrusLabs • Hyderabad, Telangana, India
    FinOps Cloud Automation Engineer (Python).Azure, AWS, and GCP environments.As a key member of the FinOps delivery team, you will work at the intersection of cloud engineering, financial governance,...Show more
    Last updated: 6 days ago • Promoted
    AWS Automation Specialist

    AWS Automation Specialist

    Creyente Infotech • Hyderabad, Republic Of India, IN
    We’re hiring a Cloud Infrastructure & SRE Engineer who doesn’t just manage systems — but engineers reliability into everything. At Creyente Infotech, we’re building real-time platforms that power in...Show more
    Last updated: 2 days ago • Promoted
    Python Automation Engineer

    Python Automation Engineer

    XpertDox India Pvt Ltd • Hyderabad, IN
    Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM). Familiarity with Windows and Linux fundam...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer (Backend) - Python

    AI Engineer (Backend) - Python

    Edstem Technologies • Hyderabad, IN
    We are building the next generation of AI-powered applications that deliver actionable financial and marketing insights to our clients. As an AI Engineer focused on backend development, you'll be in...Show more
    Last updated: 11 days ago • Promoted
    FinOps Automation Specialist (Python)

    FinOps Automation Specialist (Python)

    CirrusLabs • Hyderabad, Republic Of India, IN
    FinOps Cloud Automation Engineer (Python).Azure, AWS, and GCP environments.As a key member of the FinOps delivery team, you will work at the intersection of cloud engineering, financial governance,...Show more
    Last updated: 6 days ago • Promoted
    Python Web Services Engineer

    Python Web Services Engineer

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    TCS is Hiring For Python Developer.Must have 6+ years of IT experience.Excellent coding skills in Python.Excellent understanding on Python OOPS programming. Ability to integrate multiple data source...Show more
    Last updated: 30+ days ago • Promoted
    SDET (Python, BDD, Automation, Web Services, Selenium)

    SDET (Python, BDD, Automation, Web Services, Selenium)

    S&P Global • Hyderabad, India
    Grade Level (for internal use) : .The Quality Engineering team works in partnership with other Technology Functions and the Business to ensure quality delivery of our products.The team works in an Ag...Show more
    Last updated: 5 days ago • Promoted
    Scientific Workflow Automation Engineer

    Scientific Workflow Automation Engineer

    Capgemini Engineering • Hyderabad, Republic Of India, IN
    Yrs Hands-on experience with Genedata Biologics, Screener and similar.Proficiency in scripting languages (Python, Jython, R) and bash environments. Familiarity with Git, Nextflow, relational databas...Show more
    Last updated: 19 days ago • Promoted
    Python Web Scraping Engineer – Automation (3 To 10 Yrs)

    Python Web Scraping Engineer – Automation (3 To 10 Yrs)

    AIMLEAP • Secunderabad, Republic Of India, IN
    Python Web Scraping Engineer – Advanced Automation (WFH).Bachelor’s degree in Computer Science, IT, or related field.IT / Software Services / Data & AI. Strong hands-on experience handling.Selenium,...Show more
    Last updated: 1 day ago • Promoted
    Sr Python Gen AI engineers

    Sr Python Gen AI engineers

    Adecco • Hyderabad, Telangana, India
    Develop generative AI solutions on AWS, focusing on LLMs, prompt engineering, RAG, and agentic AI using n8n and Python libraries like LangChain. Anthropic Claude) on AWS Bedrock with boto3.Fine-tune...Show more
    Last updated: 16 days ago • Promoted
    Python Automation Engineer

    Python Automation Engineer

    Quess Corp Limited • Hyderabad, Republic Of India, IN
    Experience : 6 Years (Relevant 3+ years).Location : Hyderabad & Bangalore & Pune.Design, develop and maintain scalable Python-based modules and workflows for AI / data / simulation applications.Work with...Show more
    Last updated: 6 hours ago • Promoted • New!
    Python Web API Engineer (ML Focus)

    Python Web API Engineer (ML Focus)

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    Python Web API Developer with ML.Python Web API Developer with ML.Desired Competencies (Technical / Behavioral Competency). Solid understanding of object-oriented programming (OOP) and design patterns...Show more
    Last updated: 3 days ago • Promoted
    Senior Python Automation Engineer - Playwright - (Immediate joiners only)

    Senior Python Automation Engineer - Playwright - (Immediate joiners only)

    Innovya Technologies • Hyderabad, IN
    Innovya Technologies is a dynamic and growing software consulting firm that drives business automation with cutting-edge solutions. We help businesses quickly realize value from their technology and...Show more
    Last updated: 17 hours ago • Promoted • New!
    Python Web Application Specialist

    Python Web Application Specialist

    People Prime Worldwide • Hyderabad, Republic Of India, IN
    Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA.Founded in 1996, with a revenue of $1. B, with 35,000+ associates worldwide, specializes in digital engin...Show more
    Last updated: 6 hours ago • Promoted • New!
    Sr Python Gen Ai Engineers

    Sr Python Gen Ai Engineers

    Adecco • Hyderabad, Republic Of India, IN
    Develop generative AI solutions on AWS, focusing on LLMs, prompt engineering, RAG, and agentic AI using n8n and Python libraries like LangChain. Anthropic Claude) on AWS Bedrock with boto3.Fine-tune...Show more
    Last updated: 16 days ago • Promoted
    Finops Cloud Automation Engineer(Python)

    Finops Cloud Automation Engineer(Python)

    CirrusLabs • Hyderabad, India
    Job Title : FinOps Cloud Automation Engineer (Python).CirrusLabs is a modern digital transformation partner focused on helping enterprises accelerate value from cloud, data, and automation.We are ex...Show more
    Last updated: 3 days ago • Promoted