Python Automation & Web Scraping Engineer (2 to 4 yrs)AIMLEAP • Erode, IN
Python Automation & Web Scraping Engineer (2 to 4 yrs)
AIMLEAP • Erode, IN
1 day ago
Job descriptionDevelop, maintain, and optimize Python-based scraping scripts and automation pipelines . Extract data from both static and dynamic websites, including sites requiring browser automation. Manage pagination, login / authentication , and session-based scraping workflows. Build and maintain REST APIs using Flask / Django to integrate data and automation services. Implement data pipelines for cleaning, transforming, and storing outputs (CSV, Excel, JSON, DB). Work with MySQL, PostgreSQL, MongoDB, Redis for structured and unstructured data storage. Use Docker for containerizing automation modules and assist in basic cloud deployments. Troubleshoot failures, implement retry / recovery logic, and ensure high accuracy of extracted data. Maintain documentation, logging, and monitoring for all scraping and automation tasks. Solid programming experience in Python . Hands-on experience with Selenium, BeautifulSoup, Requests (Playwright / Scrapy optional but good to have). Understanding of HTTP, APIs, headers, cookies, sessions , and basic browser automation concepts. Experience with backend frameworks like Flask or Django . Familiarity with Docker and Git-based workflows. Knowledge of relational and non-relational databases (MySQL / PostgreSQL / MongoDB / Redis). Strong debugging, optimization, and troubleshooting abilities.
Python Automation & Web Scraping Engineer (WFH)
Experience : 2–4 Years
Location : Remote
Mode of Engagement : Full-time
No of Positions : 3
Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology
Industry : IT / Software Development
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- Strong hands-on experience in Python for automation and mid-scale web scraping projects.
- Experience with Selenium, BeautifulSoup, Requests , and automation-driven scraping workflows.
- Good understanding of HTML, CSS, DOM structures , and dynamic / JavaScript-rendered websites.
- Experience in backend / API development using Flask or Django .
- Ability to handle cookies, sessions, authentication flows, headers , and basic anti-bot mechanisms.
- Strong skills in debugging, error handling, data cleaning, and optimization of scraping pipelines.
Key Responsibilities :
Qualifications :
Create a job alert for this search
Automation Engineer • Erode, IN
Related jobs
AI Engineer (Backend) - Python
Edstem Technologies • Erode, IN
We are building the next generation of AI-powered applications that deliver actionable financial and marketing insights to our clients.
As an AI Engineer focused on backend development, you'll be in...Show more
Last updated: 6 days ago • Promoted
Senior AI / ML Engineer
Luxoft • Salem,Tamil Nadu, IN
Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process.
We are seeking a highly skilled and innovative Python / AI Engine...Show more
Last updated: 17 days ago • Promoted
Applied AI Engineer
Strategic Talent Partner • Tiruppur, IN
Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain.
Implement reasoning techniques (CoT, ToT, G...Show more
Last updated: 21 days ago • Promoted
Ai Engineer
BeGig • Erode, Republic Of India, IN
Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
Last updated: 7 days ago • Promoted
Senior / Lead / Principal SDET - Python automation(Storage)
DDN • Salem,Tamil Nadu, IN
This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades.
DataDirect Networks (DDN) is a globa...Show more
Last updated: 8 days ago • Promoted
Prompt Engineer
Innodata Inc. • Erode, IN
Demonstrated experience programmatically using LLMs to automate data labeling, classification, localization and annotation tasks.
Strong expertise in Python for NLU, for data processing & transforma...Show more
Last updated: 20 days ago • Promoted
Data Engineer
Mastek • Erode, IN
Deep hands-on experience with Unity Catalog — creating and managing catalogs, schemas, and tables.Experience automating data onboarding and metadata registration via Unity Catalog APIs or Databrick...Show more
Last updated: 14 days ago • Promoted
Web Crawling Engineer
Forage AI • Erode, IN
The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.
Forage AI is a pioneering A...Show more
Last updated: 13 days ago • Promoted
Forward Deployed Engineer
Searchability® • Erode, IN
Forward Deployed Engineer - AI💻.Remote-based - relocation to Dubai📍.Searchability MENA is working with an innovative AI startup looking for a.
This is a rare chance to get involved with a company ...Show more
Last updated: 7 days ago • Promoted
Python Automation Engineer
XpertDox India Pvt Ltd • Tiruppur, IN
Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM).
Familiarity with Windows and Linux fundam...Show more
Last updated: 30+ days ago • Promoted
Data Engineer - Web Scraping
Alternative Path • Salem,Tamil Nadu, IN
Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show more
Last updated: 30+ days ago • Promoted
Python Automation Developer - PAN India
Concentrix • tiruppur, tamil nadu, in
Looking for Python Expertise with minimum 6+ years of experience with having below must have skills : .Experience in automating business processes using Python.
Integrate bots with databases (SQL, Pos...Show more
Last updated: 14 hours ago • Promoted • New!
Python Developer – GenAI & Agentic AI
PROADSW3 Relations pvt. ltd. • erode, India
Hiring : Python Developer – GenAI & Agentic AI | 5–7 Years | Bangalore / Remote | Immediate Joiners.Show more
Last updated: 8 hours ago • Promoted • New!
Python Developer (Web Crawling Exp)
DBiz.ai • Salem, Tamil Nadu, India
Python Developer (Web Crawling Exp) - 5+years - Kochi Responsibilities : Develop and maintain efficient web crawlers with a focus on speed, performance, and scalability.Write clean, reusable, an...Show more
Last updated: 8 hours ago • Promoted • New!
Python Automation Developer - Pan India
Concentrix • Tiruppur, Republic Of India, IN
Looking for Python Expertise with minimum 6+ years of experience with having below must have skills : .Experience in automating business processes using Python.
Integrate bots with databases (SQL, Pos...Show more
Last updated: 8 hours ago • Promoted • New!
AI Web Scraping Engineer
S2T AI - AI-Powered Investigations • Tiruppur, IN
We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more
Last updated: 30+ days ago • Promoted
Python Automation & Web Scraping Engineer (2 To 4 Yrs)
AIMLEAP • Tiruppur, Republic Of India, IN
Python Automation & Web Scraping Engineer (WFH).Bachelor’s degree in Computer Science / Information Technology.Selenium, BeautifulSoup, Requests.
Experience in backend / API development using.Strong s...Show more
Last updated: 1 day ago • Promoted
Backend Python Engineer - 17852
Turing • Tiruppur, IN
We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models think, reason, and ...Show more
Last updated: 19 days ago • Promoted