Python Developer – Web Scraping & Automation (3 to 5 yrs)AIMLEAP • Kalyan-Dombivli, IN
Python Developer – Web Scraping & Automation (3 to 5 yrs)
AIMLEAP • Kalyan-Dombivli, IN
3 days ago
Job descriptionDevelop, optimize, and maintain web scraping scripts and automation pipelines in Python. Extract data from static, dynamic, and JavaScript-heavy websites using browser automation. Manage pagination, authentication of workflows, cookies, sessions , and rendering challenges. Build and maintain REST APIs to support data access and processing. Implement end-to-end pipelines for data cleaning, transformation, and storage (CSV, JSON, DB). Work with SQL / NoSQL databases to store and manage scraped datasets. Use Docker for containerization and deploy scraping tools to cloud environments. Troubleshoot scraping failures, automate recovery, and ensure high data accuracy. Maintain logs, monitoring, and documentation for scraping workflows. Strong programming experience in Python . Proficiency with Scrapy, Beautiful Soup, Selenium, Playwright, and Requests . Understanding HTTP, APIs, headers, cookies, sessions, and web protocols. Experience with backend frameworks : FastAPI / Django / Flask . Experience working with Docker and basic CI / CD workflows is good to have . Knowledge of relational and non-relational databases. Strong debugging, optimization, and troubleshooting abilities.
Python Developer – Web Scraping & Automation (WFH)
Experience : 3-5 Years
Location : Remote
Mode of Engagement : Full-time
No of Positions : 3
Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology
Industry : IT / Software Development
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- Strong hands-on experience in Python for large-scale web scraping and automation.
- Expert in web scraping using Scrapy, BeautifulSoup, Selenium, Playwright, and Requests.
- Excellent understanding of HTML, CSS, DOM structure , and browser-rendered content.
- Experience in backend / API development using FastAPI, Django, or Flask .
- Ability to handle proxies, user-agent rotation, cookies, sessions, and anti-bot mechanisms.
- Strong debugging, error-handling, and optimization skills.
- Ability to independently deliver reliable and scalable data extraction solutions.
Key Responsibilities :
Qualifications :
Create a job alert for this search
Python Developer • Kalyan-Dombivli, IN
Related jobs
Python Developer (Scripting, Automation & Microservices)
Codesis Technologies Private Limited • mumbai, maharashtra, in
We’re looking for a Python Developer with deep hands-on experience in scripting and automation, along with a solid background in microservices API development.
You will build tools, scripts, and ser...Show more
Last updated: 14 days ago • Promoted
Python Developer
VAYUZ Technologies • mumbai, maharashtra, in
Develop, enhance, and maintain full-stack applications using.Design, develop, and manage databases using.API development and integration.
Containerize applications using.Work closely with the team f...Show more
Last updated: 21 hours ago • Promoted • New!
Senior Python Developer
DBiz.ai • Thane, IN
Develop and maintain efficient.Write clean, reusable, and optimized.Analyze and understand website structures, implement logic to handle.
Collaborate with backend and data teams to ensure smooth dat...Show more
Last updated: 3 hours ago • Promoted • New!
Web Crawling Engineer
Forage AI • Mumbai, IN
The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.
Forage AI is a pioneering A...Show more
Last updated: 9 days ago • Promoted
Senior Python Developer / Lead Python Developer
Apptad • Kalyan-Dombivli, IN
We are looking for a Python Developer to design and implement enrichment and lookup services for UL (Upstream / Downstream) message processing.
The role requires strong fundamentals in Python and data...Show more
Last updated: 2 hours ago • Promoted • New!
Senior Python Developer
Aarav Solutions • mumbai, maharashtra, in
Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show more
Last updated: 30+ days ago • Promoted
AI Web Scraping Engineer
S2T AI - AI-Powered Investigations • Mumbai, IN
We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more
Last updated: 30+ days ago • Promoted
Senior Python Developer
Luxoft • Thane, IN
We're seeking a strong and creative Software Engineer eager to solve challenging problems of scale and work on cutting edge technologies.
In this project, you will have the opportunity to write code...Show more
Last updated: 4 hours ago • Promoted • New!
Python Developer
Tredence Inc. • mumbai city, maharashtra, in
Job Summary : We are looking for a highly skilled Python Developer with strong experience in AWS serverless technologies, particularly AWS Lambda.
The ideal candidate will be proficient in building a...Show more
Last updated: 27 days ago • Promoted
Automation Engineer
Sourcebae • Thane, IN
Senior Python Automation Engineer / Lead (6+ Yrs) | Selenium, Playwright, CI / CD | Hybrid 🚀.We are seeking a highly experienced and technically strong.
Senior Python Automation Engineer / Lead.This ...Show more
Last updated: 7 days ago • Promoted
Python full stack developer
Digivance Solutions • Thane, IN
Design and develop robust, scalable, and secure full-stack web applications.Collaborate with cross-functional teams to understand requirements and translate them into technical solutions.Architect ...Show more
Last updated: 2 hours ago • Promoted • New!
Python Automation Engineer
XpertDox India Pvt Ltd • Kalyan-Dombivli, IN
Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM).
Familiarity with Windows and Linux fundam...Show more
Last updated: 30+ days ago • Promoted
Python Developer
PANDIT AI • mumbai, maharashtra, in
Immediate Joining Required — 1 week or less.We are looking for a highly skilled.APIs, and integrations for our AI-powered platform.
You will work closely with our engineering team to develop robust,...Show more
Last updated: 21 hours ago • Promoted • New!
Python Developer
Huxley • dombivli, maharashtra, in
This team oversees the entire advertising technology ecosystem that powers global ad operations.It is a cross-functional, data-driven organization with members distributed across multiple countries...Show more
Last updated: 2 days ago • Promoted
Lead Developer- Python
G10X • Thane, IN
We are looking for a Backend Developer Lead with 7+ years of hands-on development experience.The ideal candidate should be strong in backend engineering, with Python, and capable of leading a team ...Show more
Last updated: 4 hours ago • Promoted • New!
Senior / Lead / Principal SDET - Python automation(Storage)
DDN • Thane, IN
This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades.
DataDirect Networks (DDN) is a globa...Show more
Last updated: 3 days ago • Promoted
Python Developer
HonestAI - Building AI Powered Apps & Agentifying Companies • navi mumbai, maharashtra, in
At HonestAI-GrayCyan, we specialize in turning the promise of Artificial Intelligence into practical results.We deliver tailored AI solutions and Agents to build AI-powered SaaS Tech Apps, streamli...Show more
Last updated: 2 days ago • Promoted
Python Developer
TIGI HR • mumbai, maharashtra, in
Develop and maintain scalable back-end systems, APIs, and databases.Collaborate with front-end developers to integrate user-facing elements with server logic.
Write clean, efficient, and testable co...Show more
Last updated: 30+ days ago • Promoted