Python Developer – Web Scraping & Automation (3 to 5 yrs)
AIMLEAPPalakkad, IN2 days ago
Job descriptionDevelop, optimize, and maintain web scraping scripts and automation pipelines in Python. Extract data from static, dynamic, and JavaScript-heavy websites using browser automation. Manage pagination, authentication of workflows, cookies, sessions , and rendering challenges. Build and maintain REST APIs to support data access and processing. Implement end-to-end pipelines for data cleaning, transformation, and storage (CSV, JSON, DB). Work with SQL / NoSQL databases to store and manage scraped datasets. Use Docker for containerization and deploy scraping tools to cloud environments. Troubleshoot scraping failures, automate recovery, and ensure high data accuracy. Maintain logs, monitoring, and documentation for scraping workflows. Strong programming experience in Python . Proficiency with Scrapy, Beautiful Soup, Selenium, Playwright, and Requests . Understanding HTTP, APIs, headers, cookies, sessions, and web protocols. Experience with backend frameworks : FastAPI / Django / Flask . Experience working with Docker and basic CI / CD workflows is good to have . Knowledge of relational and non-relational databases. Strong debugging, optimization, and troubleshooting abilities.
Python Developer – Web Scraping & Automation (WFH)
Experience : 3-5 Years
Location : Remote
Mode of Engagement : Full-time
No of Positions : 3
Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology
Industry : IT / Software Development
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- Strong hands-on experience in Python for large-scale web scraping and automation.
- Expert in web scraping using Scrapy, BeautifulSoup, Selenium, Playwright, and Requests.
- Excellent understanding of HTML, CSS, DOM structure , and browser-rendered content.
- Experience in backend / API development using FastAPI, Django, or Flask .
- Ability to handle proxies, user-agent rotation, cookies, sessions, and anti-bot mechanisms.
- Strong debugging, error-handling, and optimization skills.
- Ability to independently deliver reliable and scalable data extraction solutions.
Key Responsibilities :
Qualifications :
Create a job alert for this search
Python Developer • Palakkad, IN
Related jobs
- Promoted
Python Backend developer
Droisysthrissur, kerala, in Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution.
We leverage deep technical expertise, Agil...Show moreLast updated: 1 day ago
- Promoted
Python Automation Engineer
XpertDox India Pvt LtdCoimbatore, IN Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM).
Familiarity with Windows and Linux fundam...Show moreLast updated: 30+ days ago
- Promoted
Senior Web Scraping Engineer
Zomunkpalakkad, kerala, in We're building a product that relies heavily on collecting structured data from a number of known websites.We need someone experienced who can own this part of the system end-to-end; from writing s...Show moreLast updated: 23 hours ago
- Promoted
Senior Python Developer
Syscorepalakkad, kerala, in Syscore collaborates with global brands in advancing sustainability, wellness, and social good by designing innovative systems, simplifying complexity, and bringing visionary ideas to life.Combinin...Show moreLast updated: 1 day ago
- Promoted
Python Developer
Hellowork Consultantsthrissur, kerala, in Python Developer (with AWS Exposure and workflow).We are seeking a Python Developer with strong expertise in Python programming and practical exposure to AWS cloud services.The ideal candidate will...Show moreLast updated: 1 day ago
- Promoted
Python Developer
BotLab Dynamicsthrissur, kerala, in We are looking for a passionate Python Developer to join our dynamic team.If you are eager to work on impactful projects and grow in a technology-driven environment, this role is for you!.Develop, ...Show moreLast updated: 1 day ago
- Promoted
Python Developer
HonestAI - Building AI Powered Apps & Agentifying Companiescoimbatore, tamil nadu, in At HonestAI-GrayCyan, we specialize in turning the promise of Artificial Intelligence into practical results.We deliver tailored AI solutions and Agents to build AI-powered SaaS Tech Apps, streamli...Show moreLast updated: 1 day ago
- Promoted
Python Developer
Thoughtworkscoimbatore, tamil nadu, in Diversity Req-Female candidates only).Senior Software Developers collaborate with Business and Quality Analysts, Designers, Project Managers and more to design software solutions that will create m...Show moreLast updated: 1 day ago
- Promoted
Python Developer
SystemBenderpalakkad, kerala, in API development for a modern cloud-based application.This role requires a technically strong engineer with deep expertise in Python and hands-on experience in C#, Azure, and microservices architect...Show moreLast updated: 13 days ago
- Promoted
Python Developer
Huxleycoimbatore, tamil nadu, in This team oversees the entire advertising technology ecosystem that powers global ad operations.It is a cross-functional, data-driven organization with members distributed across multiple countries...Show moreLast updated: 1 day ago
- Promoted
Python Developer
LeoRixthrissur, kerala, in Senior Python Engineer (LLMs & Django) — LeoRix (AI Enterprise Hub).IST (or) 7pm to 3am IST (Offshore requirement).LeoRix is an AI-driven Enterprise Hub designed to unify and automate end-to-end bu...Show moreLast updated: 23 hours ago
- Promoted
Sr. Python Developer
Universal Softwarethrissur, kerala, in We are looking for an experienced.The ideal candidate will be responsible for designing, developing, and optimizing backend systems using Python and related frameworks.
You will collaborate with cro...Show moreLast updated: 1 day ago
- Promoted
Web Scraping Engineer
noonthrissur, kerala, in Job title : Web Scraping Engineer.The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.Develop and...Show moreLast updated: 1 day ago
- Promoted
Python Developer – Web Scraping & Automation (3 to 5 yrs)
AIMLEAPCoimbatore, IN Python Developer – Web Scraping & Automation (WFH).Bachelor’s degree in Computer Science / Information Technology .Strong hands-on experience in .
Expert in web scraping using Scrapy, BeautifulSoup,...Show moreLast updated: 2 days ago
- Promoted
Senior / Lead / Principal SDET - Python automation(Storage)
DDNCoimbatore, IN This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades.
DataDirect Networks (DDN) is a globa...Show moreLast updated: 2 days ago
- Promoted
Backend Developer - Python
VXI Global SolutionsCoimbatore, IN Job Description : We are seeking an experienced Backend Developer to join our team in the role of Lead Developer.The ideal candidate should have a strong background in Python and extensive experienc...Show moreLast updated: 6 days ago
- Promoted
Python Developer
Netra Labscoimbatore, tamil nadu, in Netra Labs redefines enterprise AI with Ground Truth , a platform that transforms expertise into powerful AI agents.This technology allows businesses to create digital twins that automate complex t...Show moreLast updated: 1 day ago
- Promoted
Python Automation Developer
Tata Technologiespalakkad, kerala, in Proficiency in Python (Advanced level).C Programming (Intermediate level).Experience with Shell Scripting.Familiarity with Linux Environment (Command based).
Hands-on experience with Github.Show moreLast updated: 1 day ago