Talent.com
Python Automation & Web Scraping Engineer (2 to 4 yrs)
Python Automation & Web Scraping Engineer (2 to 4 yrs)AIMLEAP • vapi, gujarat, in
Python Automation & Web Scraping Engineer (2 to 4 yrs)

Python Automation & Web Scraping Engineer (2 to 4 yrs)

AIMLEAP • vapi, gujarat, in
20 hours ago
Job description

Python Automation & Web Scraping Engineer (WFH)

Experience : 2–4 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • Strong hands-on experience in Python for automation and mid-scale web scraping projects.
  • Experience with Selenium, BeautifulSoup, Requests , and automation-driven scraping workflows.
  • Good understanding of HTML, CSS, DOM structures , and dynamic / JavaScript-rendered websites.
  • Experience in backend / API development using Flask or Django .
  • Ability to handle cookies, sessions, authentication flows, headers , and basic anti-bot mechanisms.
  • Strong skills in debugging, error handling, data cleaning, and optimization of scraping pipelines.

Key Responsibilities :

  • Develop, maintain, and optimize Python-based scraping scripts and automation pipelines .
  • Extract data from both static and dynamic websites, including sites requiring browser automation.
  • Manage pagination, login / authentication , and session-based scraping workflows.
  • Build and maintain REST APIs using Flask / Django to integrate data and automation services.
  • Implement data pipelines for cleaning, transforming, and storing outputs (CSV, Excel, JSON, DB).
  • Work with MySQL, PostgreSQL, MongoDB, Redis for structured and unstructured data storage.
  • Use Docker for containerizing automation modules and assist in basic cloud deployments.
  • Troubleshoot failures, implement retry / recovery logic, and ensure high accuracy of extracted data.
  • Maintain documentation, logging, and monitoring for all scraping and automation tasks.
  • Qualifications :

  • Solid programming experience in Python .
  • Hands-on experience with Selenium, BeautifulSoup, Requests (Playwright / Scrapy optional but good to have).
  • Understanding of HTTP, APIs, headers, cookies, sessions , and basic browser automation concepts.
  • Experience with backend frameworks like Flask or Django .
  • Familiarity with Docker and Git-based workflows.
  • Knowledge of relational and non-relational databases (MySQL / PostgreSQL / MongoDB / Redis).
  • Strong debugging, optimization, and troubleshooting abilities.
  • Create a job alert for this search

    Automation Engineer • vapi, gujarat, in

    Related jobs
    Software Engineer

    Software Engineer

    Tilda Research • vapi, gujarat, in
    A passion for building scalable AI agents.Build scalable back-end services using.Optimize graph database queries and models in Neo4j. Collaborate cross-functionally with Product, Engineering, and Cl...Show more
    Last updated: 2 days ago • Promoted
    Cloud IAM Engineer

    Cloud IAM Engineer

    Vertex Agility • vapi, gujarat, in
    Job title : Cloud IAM Engineer.Join Vertex Agility — a high-performance, remote-first consultancy shaping the future of identity security and cloud-native automation. Own and deploy IAM across cloud...Show more
    Last updated: 2 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • vapi, gujarat, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show more
    Last updated: 28 days ago • Promoted
    Web Crawling Engineer

    Web Crawling Engineer

    Forage AI • vapi, gujarat, in
    The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Forage AI is a pioneering A...Show more
    Last updated: 12 days ago • Promoted
    IT Analyst (Gujarat - Onsite)

    IT Analyst (Gujarat - Onsite)

    CloudLabs Inc • Gandevi, Gujarat, India
    CloudLabs Inc was founded in 2014 with the mission to provide exceptional IT & Business consulting services at a competitive price, to help clients realize the best value from their investments.Wit...Show more
    Last updated: 20 days ago • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • vapi, gujarat, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 6 days ago • Promoted
    Prompt Engineer

    Prompt Engineer

    Innodata Inc. • vapi, gujarat, in
    Demonstrated experience programmatically using LLMs to automate data labeling, classification, localization and annotation tasks. Strong expertise in Python for NLU, for data processing & transforma...Show more
    Last updated: 19 days ago • Promoted
    Python Developer

    Python Developer

    Tata Consultancy Services • vapi, gujarat, in
    Required Skillset : Python, OOP, Django, Fast API.Core Python Knowledge, which is most important for any framework.Libraries and Frameworks (eg : Django, FastAPI etc). At least basic knowledge of depl...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Estimation Engineer - LV / MV Switchboards

    Sr. Estimation Engineer - LV / MV Switchboards

    Jatson Power Pvt.Ltd • Valsad, Gujarat, India
    Valsad, Gujarat location, with 5 to 8 years of experience in estimating LV & MV electrical panels.Review inquiry documents to understand project scope and technical requirements.Prepare accurate BO...Show more
    Last updated: 4 days ago • Promoted
    Robotic Process Automation Consultant

    Robotic Process Automation Consultant

    ACL Digital • vapi, gujarat, in
    Hiring for RPA Developer : Remote Opportunity.Power Automate experience is an added advantage.Finance project experience preferred, but FinTech domain is. Excellent communication skills; candidate wi...Show more
    Last updated: 4 days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Live Connections • vapi, gujarat, in
    We’re Hiring – Senior Engineers.Open Position 1 – Senior Engineer.Strong frontend or strong full-stack expertise.Experience in design / architecture. Must have worked in a large e-commerce environment...Show more
    Last updated: 4 days ago • Promoted
    TOSCA

    TOSCA

    Tata Consultancy Services • vapi, gujarat, in
    TCS is looking for TOSCA applications.Should have overall 4+ years of experience with 3+ years of experience in TOSCA and cloud orchestration principles. Hands-on experience with TOSCA-based orchest...Show more
    Last updated: 20 days ago • Promoted
    Python Automation & Web Scraping Engineer (2 To 4 Yrs)

    Python Automation & Web Scraping Engineer (2 To 4 Yrs)

    AIMLEAP • Vapi, Republic Of India, IN
    Python Automation & Web Scraping Engineer (WFH).Bachelor’s degree in Computer Science / Information Technology.Selenium, BeautifulSoup, Requests. Experience in backend / API development using.Strong s...Show more
    Last updated: 11 hours ago • Promoted • New!
    AI Engineer (Backend) - Python

    AI Engineer (Backend) - Python

    Edstem Technologies • vapi, gujarat, in
    We are building the next generation of AI-powered applications that deliver actionable financial and marketing insights to our clients. As an AI Engineer focused on backend development, you'll be in...Show more
    Last updated: 6 days ago • Promoted
    Python Developer

    Python Developer

    MyData Insights Pvt Ltd • vapi, gujarat, in
    We are seeking a Python / FastAPI Development Lead with strong expertise in FastAPI to join an exciting Reinforcement Learning (RL) Gym project. You will design, build, and optimize scalable APIs, col...Show more
    Last updated: 4 days ago • Promoted
    Python & Django Developer (Full Stack AI)

    Python & Django Developer (Full Stack AI)

    bCatalyst Labs • vapi, gujarat, in
    Catalyst Labs is building the future of Voice AI infrastructure with a powerful SaaS platform that helps developers and enterprises create, deploy, manage, and scale Voice AI agents effortlessly.We...Show more
    Last updated: 4 hours ago • Promoted • New!
    Python Developer

    Python Developer

    GoML • vapi, gujarat, in
    We are in search of a passionate and skilled Python Developer to join our dynamic team.This role is ideal for someone with a profound expertise in Python and its ecosystem, focused on backend devel...Show more
    Last updated: 4 days ago • Promoted
    Full Stack Engineer (Python + JS / TS) - 17853

    Full Stack Engineer (Python + JS / TS) - 17853

    Turing • vapi, gujarat, in
    Turing is seeking experienced Full Stack Engineers to help build end-to-end AI-driven applications for US customers — spanning backend services, web frontends, and evaluation tooling.In this role, ...Show more
    Last updated: 18 days ago • Promoted