Talent.com
Python Automation & Web Scraping Engineer (2 to 4 yrs)
Python Automation & Web Scraping Engineer (2 to 4 yrs)AIMLEAP • panipat, haryana, in
Python Automation & Web Scraping Engineer (2 to 4 yrs)

Python Automation & Web Scraping Engineer (2 to 4 yrs)

AIMLEAP • panipat, haryana, in
14 hours ago
Job description

Python Automation & Web Scraping Engineer (WFH)

Experience : 2–4 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • Strong hands-on experience in Python for automation and mid-scale web scraping projects.
  • Experience with Selenium, BeautifulSoup, Requests , and automation-driven scraping workflows.
  • Good understanding of HTML, CSS, DOM structures , and dynamic / JavaScript-rendered websites.
  • Experience in backend / API development using Flask or Django .
  • Ability to handle cookies, sessions, authentication flows, headers , and basic anti-bot mechanisms.
  • Strong skills in debugging, error handling, data cleaning, and optimization of scraping pipelines.

Key Responsibilities :

  • Develop, maintain, and optimize Python-based scraping scripts and automation pipelines .
  • Extract data from both static and dynamic websites, including sites requiring browser automation.
  • Manage pagination, login / authentication , and session-based scraping workflows.
  • Build and maintain REST APIs using Flask / Django to integrate data and automation services.
  • Implement data pipelines for cleaning, transforming, and storing outputs (CSV, Excel, JSON, DB).
  • Work with MySQL, PostgreSQL, MongoDB, Redis for structured and unstructured data storage.
  • Use Docker for containerizing automation modules and assist in basic cloud deployments.
  • Troubleshoot failures, implement retry / recovery logic, and ensure high accuracy of extracted data.
  • Maintain documentation, logging, and monitoring for all scraping and automation tasks.
  • Qualifications :

  • Solid programming experience in Python .
  • Hands-on experience with Selenium, BeautifulSoup, Requests (Playwright / Scrapy optional but good to have).
  • Understanding of HTTP, APIs, headers, cookies, sessions , and basic browser automation concepts.
  • Experience with backend frameworks like Flask or Django .
  • Familiarity with Docker and Git-based workflows.
  • Knowledge of relational and non-relational databases (MySQL / PostgreSQL / MongoDB / Redis).
  • Strong debugging, optimization, and troubleshooting abilities.
  • Create a job alert for this search

    Automation Engineer • panipat, haryana, in

    Related jobs
    Web Crawling Engineer

    Web Crawling Engineer

    Forage AI • narela, delhi, in
    The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Forage AI is a pioneering A...Show more
    Last updated: 12 days ago • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • panipat, haryana, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 6 days ago • Promoted
    Staff Software Engineer

    Staff Software Engineer

    Arcana • narela, delhi, in
    Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Staff / Lead Backend Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamen...Show more
    Last updated: 14 hours ago • Promoted • New!
    Senior Software Engineer (Python, React)

    Senior Software Engineer (Python, React)

    Better Software • panipat, haryana, in
    Better Software is a product development studio that partners with entrepreneurs and enterprises to launch new initiatives. Many of these products evolve into large-scale systems, and we act as long...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer (Backend) - Python

    AI Engineer (Backend) - Python

    Edstem Technologies • narela, delhi, in
    We are building the next generation of AI-powered applications that deliver actionable financial and marketing insights to our clients. As an AI Engineer focused on backend development, you'll be in...Show more
    Last updated: 5 days ago • Promoted
    AWS devops engineer

    AWS devops engineer

    techifyapps • narela, delhi, in
    We are looking for a skilled AWS DevOps Engineer to join our growing engineering team.The ideal candidate should have strong hands-on experience in designing CI / CD pipelines, containerized deployme...Show more
    Last updated: 3 days ago • Promoted
    Python Developer

    Python Developer

    MyData Insights Pvt Ltd • narela, delhi, in
    We are seeking a Python / FastAPI Development Lead with strong expertise in FastAPI to join an exciting Reinforcement Learning (RL) Gym project. You will design, build, and optimize scalable APIs, col...Show more
    Last updated: 4 days ago • Promoted
    AIML Engineer

    AIML Engineer

    Tata Consultancy Services • panipat, haryana, in
    Competencies (Technical / Behavioral Competency).AI / ML, Azure ML Studio, AI / ML On Databricks, Python & CICD Devops.Supervised and unsupervised ML and Predictive Analytics using Python • Feature gener...Show more
    Last updated: 19 days ago • Promoted
    Senior Python Developer

    Senior Python Developer

    Aarav Solutions • narela, delhi, in
    Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show more
    Last updated: 30+ days ago • Promoted
    Poultry Technical Sales Lead

    Poultry Technical Sales Lead

    Cargill • Karnal, Haryana, India
    The Poultry - Technical Sales Lead based at Karnal will be aligned to Cargill's Animal Nutrition and Health business in India responsible for Punjab, Haryana and Uttar Pradesh regions.In this role ...Show more
    Last updated: 2 days ago • Promoted
    Prompt Engineer

    Prompt Engineer

    Innodata Inc. • panipat, haryana, in
    Demonstrated experience programmatically using LLMs to automate data labeling, classification, localization and annotation tasks. Strong expertise in Python for NLU, for data processing & transforma...Show more
    Last updated: 19 days ago • Promoted
    Python Automation & Web Scraping Engineer (2 to 4 yrs)

    Python Automation & Web Scraping Engineer (2 to 4 yrs)

    AIMLEAP • narela, delhi, in
    Python Automation & Web Scraping Engineer (WFH).Bachelor’s degree in Computer Science / Information Technology.Selenium, BeautifulSoup, Requests. Experience in backend / API development using.Strong s...Show more
    Last updated: 14 hours ago • Promoted • New!
    Python Automation & Web Scraping Engineer (2 To 4 Yrs)

    Python Automation & Web Scraping Engineer (2 To 4 Yrs)

    AIMLEAP • Narela, Republic Of India, IN
    Python Automation & Web Scraping Engineer (WFH).Bachelor’s degree in Computer Science / Information Technology.Selenium, BeautifulSoup, Requests. Experience in backend / API development using.Strong s...Show more
    Last updated: 6 hours ago • Promoted • New!
    Cloud IAM Engineer

    Cloud IAM Engineer

    Vertex Agility • narela, delhi, in
    Job title : Cloud IAM Engineer.Join Vertex Agility — a high-performance, remote-first consultancy shaping the future of identity security and cloud-native automation. Own and deploy IAM across cloud...Show more
    Last updated: 2 days ago • Promoted
    Python Developer

    Python Developer

    GoML • narela, delhi, in
    We are in search of a passionate and skilled Python Developer to join our dynamic team.This role is ideal for someone with a profound expertise in Python and its ecosystem, focused on backend devel...Show more
    Last updated: 4 days ago • Promoted
    Python Software Engineer

    Python Software Engineer

    Teamware Solutions • panipat, haryana, in
    Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt Ltd.Role : Python Software Engineer - IC.Location : Bangalore / Hyderabad / pune / Mumbai. Shift : (Flexibility Required) / ...Show more
    Last updated: 2 days ago • Promoted
    Software Engineer

    Software Engineer

    Tilda Research • narela, delhi, in
    A passion for building scalable AI agents.Build scalable back-end services using.Optimize graph database queries and models in Neo4j. Collaborate cross-functionally with Product, Engineering, and Cl...Show more
    Last updated: 1 day ago • Promoted
    Full Stack Engineer (Python + JS / TS) - 17853

    Full Stack Engineer (Python + JS / TS) - 17853

    Turing • panipat, haryana, in
    Turing is seeking experienced Full Stack Engineers to help build end-to-end AI-driven applications for US customers — spanning backend services, web frontends, and evaluation tooling.In this role, ...Show more
    Last updated: 17 days ago • Promoted