Talent.com
Python Automation & Web Scraping Engineer (2 to 4 yrs)
Python Automation & Web Scraping Engineer (2 to 4 yrs)AIMLEAP • bhopal, madhya pradesh, in
Python Automation & Web Scraping Engineer (2 to 4 yrs)

Python Automation & Web Scraping Engineer (2 to 4 yrs)

AIMLEAP • bhopal, madhya pradesh, in
1 day ago
Job description

Python Automation & Web Scraping Engineer (WFH)

Experience : 2–4 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • Strong hands-on experience in Python for automation and mid-scale web scraping projects.
  • Experience with Selenium, BeautifulSoup, Requests , and automation-driven scraping workflows.
  • Good understanding of HTML, CSS, DOM structures , and dynamic / JavaScript-rendered websites.
  • Experience in backend / API development using Flask or Django .
  • Ability to handle cookies, sessions, authentication flows, headers , and basic anti-bot mechanisms.
  • Strong skills in debugging, error handling, data cleaning, and optimization of scraping pipelines.

Key Responsibilities :

  • Develop, maintain, and optimize Python-based scraping scripts and automation pipelines .
  • Extract data from both static and dynamic websites, including sites requiring browser automation.
  • Manage pagination, login / authentication , and session-based scraping workflows.
  • Build and maintain REST APIs using Flask / Django to integrate data and automation services.
  • Implement data pipelines for cleaning, transforming, and storing outputs (CSV, Excel, JSON, DB).
  • Work with MySQL, PostgreSQL, MongoDB, Redis for structured and unstructured data storage.
  • Use Docker for containerizing automation modules and assist in basic cloud deployments.
  • Troubleshoot failures, implement retry / recovery logic, and ensure high accuracy of extracted data.
  • Maintain documentation, logging, and monitoring for all scraping and automation tasks.
  • Qualifications :

  • Solid programming experience in Python .
  • Hands-on experience with Selenium, BeautifulSoup, Requests (Playwright / Scrapy optional but good to have).
  • Understanding of HTTP, APIs, headers, cookies, sessions , and basic browser automation concepts.
  • Experience with backend frameworks like Flask or Django .
  • Familiarity with Docker and Git-based workflows.
  • Knowledge of relational and non-relational databases (MySQL / PostgreSQL / MongoDB / Redis).
  • Strong debugging, optimization, and troubleshooting abilities.
  • Create a job alert for this search

    Automation Engineer • bhopal, madhya pradesh, in

    Related jobs
    Web Crawling Engineer

    Web Crawling Engineer

    Forage AI • bhopal, madhya pradesh, in
    The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Forage AI is a pioneering A...Show more
    Last updated: 13 days ago • Promoted
    Python Developer (Web Crawling Exp)

    Python Developer (Web Crawling Exp)

    DBiz.ai • bhopal, India
    Python Developer (Web Crawling Exp) - 5+years - Kochi.Develop and maintain efficient.Write clean, reusable, and optimized. Analyze and understand website structures, implement logic to handle.Collab...Show more
    Last updated: 8 hours ago • Promoted • New!
    Senior / Lead / Principal SDET - Python automation(Storage)

    Senior / Lead / Principal SDET - Python automation(Storage)

    DDN • bhopal, madhya pradesh, in
    This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a globa...Show more
    Last updated: 7 days ago • Promoted
    Senior Python Developer

    Senior Python Developer

    HISH IT SERVICES • bhopal, madhya pradesh, in
    Role : Senior Python Developer.Location : Remote(Banglore,Chennai,Pune).Pay : 23LPA - 27 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12...Show more
    Last updated: 10 days ago • Promoted
    Senior Python Developer

    Senior Python Developer

    Aarav Solutions • bhopal, madhya pradesh, in
    Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI & Automation Engineer

    Senior AI & Automation Engineer

    engineersmind • bhopal, madhya pradesh, in
    Role : Senior AI & Automation Engineer.Quality Engineering & Product Assurance.API layers, ensuring seamless integration, performance, and security. This is a hands-on role that requires strong techn...Show more
    Last updated: 7 days ago • Promoted
    Senior AI Engineer

    Senior AI Engineer

    BeGig • bhopal, madhya pradesh, in
    We are looking for an experienced.The ideal candidate should be proficient in FastAPI, Python, LangChain, and modern AI application design. You will be responsible for designing, developing, and dep...Show more
    Last updated: 14 hours ago • Promoted • New!
    Full Stack Engineer - Reactjs, Python

    Full Stack Engineer - Reactjs, Python

    RiDiK (a Subsidiary of CLPS. Nasdaq : CLPS) • bhopal, madhya pradesh, in
    ReactJS, TypeScript, Python and AWS.This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to the success of a growing company.If you’...Show more
    Last updated: 14 hours ago • Promoted • New!
    Python Developer

    Python Developer

    Tata Consultancy Services • bhopal, madhya pradesh, in
    Required Skillset : Python, OOP, Django, Fast API.Core Python Knowledge, which is most important for any framework.Libraries and Frameworks (eg : Django, FastAPI etc). At least basic knowledge of depl...Show more
    Last updated: 30+ days ago • Promoted
    Backend Python Engineer - 17852

    Backend Python Engineer - 17852

    Turing • bhopal, madhya pradesh, in
    We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and ...Show more
    Last updated: 18 days ago • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • bhopal, madhya pradesh, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 7 days ago • Promoted
    Python Developer

    Python Developer

    MyData Insights Pvt Ltd • bhopal, madhya pradesh, in
    We are seeking a Python / FastAPI Development Lead with strong expertise in FastAPI to join an exciting Reinforcement Learning (RL) Gym project. You will design, build, and optimize scalable APIs, col...Show more
    Last updated: 5 days ago • Promoted
    Software Engineer

    Software Engineer

    Tilda Research • bhopal, madhya pradesh, in
    A passion for building scalable AI agents.Build scalable back-end services using.Optimize graph database queries and models in Neo4j. Collaborate cross-functionally with Product, Engineering, and Cl...Show more
    Last updated: 2 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • bhopal, madhya pradesh, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show more
    Last updated: 29 days ago • Promoted
    Python Automation Developer - PAN India

    Python Automation Developer - PAN India

    Concentrix • bhopal, madhya pradesh, in
    Looking for Python Expertise with minimum 6+ years of experience with having below must have skills : .Experience in automating business processes using Python. Integrate bots with databases (SQL, Pos...Show more
    Last updated: 14 hours ago • Promoted • New!
    Python Developer

    Python Developer

    GoML • bhopal, madhya pradesh, in
    We are in search of a passionate and skilled Python Developer to join our dynamic team.This role is ideal for someone with a profound expertise in Python and its ecosystem, focused on backend devel...Show more
    Last updated: 5 days ago • Promoted
    Cloud IAM Engineer

    Cloud IAM Engineer

    Vertex Agility • bhopal, madhya pradesh, in
    Job title : Cloud IAM Engineer.Join Vertex Agility — a high-performance, remote-first consultancy shaping the future of identity security and cloud-native automation. Own and deploy IAM across cloud...Show more
    Last updated: 3 days ago • Promoted
    AI Engineer (Data Pipelines & RAG)

    AI Engineer (Data Pipelines & RAG)

    BeGig • bhopal, madhya pradesh, in
    Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
    Last updated: 7 days ago • Promoted