Python Developer – Web Scraping & Automation (3 to 5 yrs)
AIMLEAPMumbai, IN5 days ago
Job descriptionDevelop, optimize, and maintain web scraping scripts and automation pipelines in Python. Extract data from static, dynamic, and JavaScript-heavy websites using browser automation. Manage pagination, authentication of workflows, cookies, sessions , and rendering challenges. Build and maintain REST APIs to support data access and processing. Implement end-to-end pipelines for data cleaning, transformation, and storage (CSV, JSON, DB). Work with SQL / NoSQL databases to store and manage scraped datasets. Use Docker for containerization and deploy scraping tools to cloud environments. Troubleshoot scraping failures, automate recovery, and ensure high data accuracy. Maintain logs, monitoring, and documentation for scraping workflows. Strong programming experience in Python . Proficiency with Scrapy, Beautiful Soup, Selenium, Playwright, and Requests . Understanding HTTP, APIs, headers, cookies, sessions, and web protocols. Experience with backend frameworks : FastAPI / Django / Flask . Experience working with Docker and basic CI / CD workflows is good to have . Knowledge of relational and non-relational databases. Strong debugging, optimization, and troubleshooting abilities.
Python Developer – Web Scraping & Automation (WFH)
Experience : 3-5 Years
Location : Remote
Mode of Engagement : Full-time
No of Positions : 3
Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology
Industry : IT / Software Development
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- Strong hands-on experience in Python for large-scale web scraping and automation.
- Expert in web scraping using Scrapy, BeautifulSoup, Selenium, Playwright, and Requests.
- Excellent understanding of HTML, CSS, DOM structure , and browser-rendered content.
- Experience in backend / API development using FastAPI, Django, or Flask .
- Ability to handle proxies, user-agent rotation, cookies, sessions, and anti-bot mechanisms.
- Strong debugging, error-handling, and optimization skills.
- Ability to independently deliver reliable and scalable data extraction solutions.
Key Responsibilities :
Qualifications :
Create a job alert for this search
Python Developer • Mumbai, IN
Related jobs
- Promoted
Python Developer
HonestAI - Building AI Powered Apps & Agentifying Companiesthane, maharashtra, in At HonestAI-GrayCyan, we specialize in turning the promise of Artificial Intelligence into practical results.We deliver tailored AI solutions and Agents to build AI-powered SaaS Tech Apps, streamli...Show moreLast updated: 4 days ago
- Promoted
Python Developer (Scripting, Automation & Microservices)
Codesis Technologies Private Limitedmumbai, maharashtra, in We’re looking for a Python Developer with deep hands-on experience in scripting and automation, along with a solid background in microservices API development.
You will build tools, scripts, and ser...Show moreLast updated: 17 days ago
- Promoted
Python Developer
VAYUZ Technologiesmumbai, maharashtra, in Develop, enhance, and maintain full-stack applications using.Design, develop, and manage databases using.API development and integration.
Containerize applications using.Work closely with the team f...Show moreLast updated: 3 days ago
- Promoted
- New!
Senior Python Developer
Arcitechmumbai, maharashtra, in We’re Hiring : Senior Python Developer (AI / ML) – 3 to 5 Years Experience.Are you passionate about building cutting-edge AI products?.
Do you enjoy experimenting with LLMs, building scalable RAG syste...Show moreLast updated: 21 hours ago
- Promoted
Python Developer
Sperton Global ASNavi Mumbai, Maharashtra, India We are seeking a skilled and proactive.In this role, you will collaborate on exciting software projects, designing and developing innovative solutions that power our business and benefit our custom...Show moreLast updated: 30+ days ago
- Promoted
Senior / Lead / Principal SDET - Python automation(Storage)
DDNKalyan-Dombivli, IN This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades.
DataDirect Networks (DDN) is a globa...Show moreLast updated: 5 days ago
- Promoted
Python Developer
MyData Insights Pvt Ltdmumbai city, maharashtra, in We are seeking a Python / FastAPI Development Lead with strong expertise in FastAPI to join an exciting Reinforcement Learning (RL) Gym project.
You will design, build, and optimize scalable APIs, col...Show moreLast updated: 3 days ago
- Promoted
Senior Python Developer
Aarav Solutionsmumbai, maharashtra, in Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show moreLast updated: 30+ days ago
- Promoted
- New!
Senior Python Developer
Floydee Infotech Private Limitedmumbai city, maharashtra, in We are looking for an experienced Senior Python Developer with strong expertise in data engineering, machine learning, and AI-driven application development.
In this role, you will design, build, an...Show moreLast updated: 9 hours ago
- Promoted
Senior Python Developer
Cactus CommunicationsMumbai, Maharashtra, India You will be a part of Cactus Labs which is the R&D Cell of Cactus Communications.Cactus Labs is a high impact cell that works to solve complex technical and business problems that help keep us stra...Show moreLast updated: 30+ days ago
- Promoted
Web Crawling Engineer
Forage AIKalyan-Dombivli, IN The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.
Forage AI is a pioneering A...Show moreLast updated: 11 days ago
- Promoted
Python Developer
People Prime Worldwidedombivli, maharashtra, in Our client is a Palo Alto–based AI infrastructure and talent platform founded in 2018.It helps companies connect with remote software developers using AI-powered vetting and matching technology.Ori...Show moreLast updated: 30+ days ago
- Promoted
Python Developer
GoMLmumbai city, maharashtra, in We are in search of a passionate and skilled Python Developer to join our dynamic team.This role is ideal for someone with a profound expertise in Python and its ecosystem, focused on backend devel...Show moreLast updated: 3 days ago
- Promoted
Senior Python Developer
TIH | IIT Bombaymumbai, maharashtra, in Hands-on Development & Technical Leadership.Write clean, efficient, and scalable Python code for AI-driven applications (backend & front end).
Actively contributes to core modules and critical compo...Show moreLast updated: 3 days ago
- Promoted
- New!
Webflow Developer
goatdevelopers.comKalyan-Dombivli, IN From concept to launch, we cover the full spectrum - UI / UX design, backend engineering, AI integration, and frontend development.
Our team has successfully partnered with clients across the globe, d...Show moreLast updated: 20 hours ago
- Promoted
Python Developer for a leading company in IT industry.
Sperton Global ASNavi Mumbai, Maharashtra, India JD for Python Developer for a leading IT Company in Trivandrum location.We are looking for a Python Developer who is highly capable of building robust and scalable backend services.The ideal candid...Show moreLast updated: 30+ days ago
- Promoted
Python Developer
Tata Consultancy Servicesnavi mumbai, maharashtra, in Required Skillset : Python, OOP, Django, Fast API.Core Python Knowledge, which is most important for any framework.Libraries and Frameworks (eg : Django, FastAPI etc).
At least basic knowledge of depl...Show moreLast updated: 30+ days ago
- Promoted
Python Developer
TIGI HRmumbai, maharashtra, in Develop and maintain scalable back-end systems, APIs, and databases.Collaborate with front-end developers to integrate user-facing elements with server logic.
Write clean, efficient, and testable co...Show moreLast updated: 30+ days ago