Talent.com
Python Automation & Web Scraping Engineer (2 to 4 yrs)
Python Automation & Web Scraping Engineer (2 to 4 yrs)AIMLEAP • Bengaluru, IN
Python Automation & Web Scraping Engineer (2 to 4 yrs)

Python Automation & Web Scraping Engineer (2 to 4 yrs)

AIMLEAP • Bengaluru, IN
3 days ago
Job description

Python Automation & Web Scraping Engineer (WFH)

Experience : 2–4 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • Strong hands-on experience in Python for automation and mid-scale web scraping projects.
  • Experience with Selenium, BeautifulSoup, Requests , and automation-driven scraping workflows.
  • Good understanding of HTML, CSS, DOM structures , and dynamic / JavaScript-rendered websites.
  • Experience in backend / API development using Flask or Django .
  • Ability to handle cookies, sessions, authentication flows, headers , and basic anti-bot mechanisms.
  • Strong skills in debugging, error handling, data cleaning, and optimization of scraping pipelines.

Key Responsibilities :

  • Develop, maintain, and optimize Python-based scraping scripts and automation pipelines .
  • Extract data from both static and dynamic websites, including sites requiring browser automation.
  • Manage pagination, login / authentication , and session-based scraping workflows.
  • Build and maintain REST APIs using Flask / Django to integrate data and automation services.
  • Implement data pipelines for cleaning, transforming, and storing outputs (CSV, Excel, JSON, DB).
  • Work with MySQL, PostgreSQL, MongoDB, Redis for structured and unstructured data storage.
  • Use Docker for containerizing automation modules and assist in basic cloud deployments.
  • Troubleshoot failures, implement retry / recovery logic, and ensure high accuracy of extracted data.
  • Maintain documentation, logging, and monitoring for all scraping and automation tasks.
  • Qualifications :

  • Solid programming experience in Python .
  • Hands-on experience with Selenium, BeautifulSoup, Requests (Playwright / Scrapy optional but good to have).
  • Understanding of HTTP, APIs, headers, cookies, sessions , and basic browser automation concepts.
  • Experience with backend frameworks like Flask or Django .
  • Familiarity with Docker and Git-based workflows.
  • Knowledge of relational and non-relational databases (MySQL / PostgreSQL / MongoDB / Redis).
  • Strong debugging, optimization, and troubleshooting abilities.
  • Create a job alert for this search

    Automation Engineer • Bengaluru, IN

    Related jobs
    Web Scraping & Automation Engineer

    Web Scraping & Automation Engineer

    Foresiet • Bengaluru, Republic Of India, IN
    Foresiet is an AI-enabled SaaS-based Cybersecurity company that provides a comprehensive solution for Digital Risk Prevention. Leveraging the Cyber Digital Investigator platform, Foresiet proactivel...Show more
    Last updated: 30+ days ago • Promoted
    AI Web Scraping Engineer

    AI Web Scraping Engineer

    S2T AI - AI-Powered Investigations • Bangalore, IN
    We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more
    Last updated: 30+ days ago • Promoted
    Web Crawling Engineer

    Web Crawling Engineer

    Forage AI • Bengaluru, IN
    The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Forage AI is a pioneering A...Show more
    Last updated: 15 days ago • Promoted
    Python Developer - Autonomous AI Agents

    Python Developer - Autonomous AI Agents

    Recruiting Bond • Bangalore
    Description : Who we are : My AI Client is building the foundational platform for the "agentic economy," moving beyond simple chatbots ...Show more
    Last updated: 29 days ago • Promoted
    Python Automation & Web Scraping Engineer (2 To 4 Yrs)

    Python Automation & Web Scraping Engineer (2 To 4 Yrs)

    AIMLEAP • Bengaluru, Republic Of India, IN
    Python Automation & Web Scraping Engineer (WFH).Bachelor’s degree in Computer Science / Information Technology.Selenium, BeautifulSoup, Requests. Experience in backend / API development using.Strong s...Show more
    Last updated: 3 days ago • Promoted
    Automation Engineer

    Automation Engineer

    Indee • Bengaluru, Karnataka, India
    We are seeking a highly skilled and experienced Automation Engineer to join our dynamic team.As an Automation Engineer, you will play a key role in designing, implementing, and maintaining our auto...Show more
    Last updated: 30+ days ago • Promoted
    Python Automation Engineer

    Python Automation Engineer

    NIT DATA • Bengaluru, India
    Role : Python Automation Test Data Management.Location : Bangalore / Gurgram ( Only Local Relocation Candidates not consider). Python Developer, Test Data Management or TDM.Python skills, and exposure ...Show more
    Last updated: 1 day ago • Promoted
    Python Automation Engineer

    Python Automation Engineer

    Calsoft • Bengaluru, Republic Of India, IN
    Design, develop and maintain new or existing test automation frameworks, specifically in Python.Design, develop and execute test automation suite for one or more products. Develop the test strategy / ...Show more
    Last updated: 10 days ago • Promoted
    Python Automation and Web Scraping Specialist

    Python Automation and Web Scraping Specialist

    Foresiet • Bengaluru, Karnataka, India
    Foresiet is an AI-enabled SaaS-based Cybersecurity company that provides a comprehensive solution for Digital Risk Prevention. Leveraging the Cyber Digital Investigator platform, Foresiet proactivel...Show more
    Last updated: 30+ days ago • Promoted
    Python Automation Engineer

    Python Automation Engineer

    XpertDox India Pvt Ltd • Bengaluru, IN
    Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM). Familiarity with Windows and Linux fundam...Show more
    Last updated: 30+ days ago • Promoted
    Tracxn - Senior Engineer - Web Crawling & Automation

    Tracxn - Senior Engineer - Web Crawling & Automation

    Tracxn • Bangalore
    Total Experience : 1+ years Mode of Hire : Permanent Required Skills Set (Mandatory) : JavaScript / Node.Pyth...Show more
    Last updated: 30+ days ago • Promoted
    Python Automation Engineer - Storage Systems

    Python Automation Engineer - Storage Systems

    Terralogic Software Solutions Private Limited. • Bangalore
    Total Experience : Job experience : 3+ years.Role : This is a full-time, on-site role in Bengaluru for a Python Automation with Stora...Show more
    Last updated: 30+ days ago • Promoted
    Python Automation And Web Scraping Specialist

    Python Automation And Web Scraping Specialist

    Foresiet • Bengaluru, Republic Of India, IN
    Foresiet is an AI-enabled SaaS-based Cybersecurity company that provides a comprehensive solution for Digital Risk Prevention. Leveraging the Cyber Digital Investigator platform, Foresiet proactivel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Web Scraping Engineer

    Senior Web Scraping Engineer

    Zomunk • Bangalore, IN
    We're building a product that relies heavily on collecting structured data from a number of known websites.We need someone experienced who can own this part of the system end-to-end; from writing s...Show more
    Last updated: 8 days ago • Promoted
    Python Automation Engineer - Appium / Selenium

    Python Automation Engineer - Appium / Selenium

    Vikgol • Bangalore
    Job Title : Python Automation Engineer Experience : 36 Years Location : Bangalore (Work from Office)Show more
    Last updated: 30+ days ago • Promoted
    Python Automation

    Python Automation

    Calsoft • Bengaluru, Karnataka, India
    Design, develop and maintain new or existing test automation frameworks , specifically in Python.Design, develop and execute test automation suite for one or more products.Develop the test strategy...Show more
    Last updated: 10 days ago • Promoted
    Python Automation Developer

    Python Automation Developer

    Foresiet • Bengaluru, Republic Of India, IN
    Foresiet is an AI-enabled SaaS-based Cybersecurity company that provides a comprehensive solution for Digital Risk Prevention. Leveraging the Cyber Digital Investigator platform, Foresiet proactivel...Show more
    Last updated: 30+ days ago • Promoted
    Automation Engineer - Python Programming

    Automation Engineer - Python Programming

    HINDCO Consulting Services • Bangalore
    Description : - Design, develop, test, and implement automated workflows using Python, SQL, and Power Automate.Integrate...Show more
    Last updated: 30+ days ago • Promoted