Python Developer – Web Scraping & Automation (3 to 5 yrs)
AIMLEAPsurat, gujarat, in3 days ago
Job descriptionDevelop, optimize, and maintain web scraping scripts and automation pipelines in Python. Extract data from static, dynamic, and JavaScript-heavy websites using browser automation. Manage pagination, authentication of workflows, cookies, sessions , and rendering challenges. Build and maintain REST APIs to support data access and processing. Implement end-to-end pipelines for data cleaning, transformation, and storage (CSV, JSON, DB). Work with SQL / NoSQL databases to store and manage scraped datasets. Use Docker for containerization and deploy scraping tools to cloud environments. Troubleshoot scraping failures, automate recovery, and ensure high data accuracy. Maintain logs, monitoring, and documentation for scraping workflows. Strong programming experience in Python . Proficiency with Scrapy, Beautiful Soup, Selenium, Playwright, and Requests . Understanding HTTP, APIs, headers, cookies, sessions, and web protocols. Experience with backend frameworks : FastAPI / Django / Flask . Experience working with Docker and basic CI / CD workflows is good to have . Knowledge of relational and non-relational databases. Strong debugging, optimization, and troubleshooting abilities.
Python Developer – Web Scraping & Automation (WFH)
Experience : 3-5 Years
Location : Remote
Mode of Engagement : Full-time
No of Positions : 3
Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology
Industry : IT / Software Development
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- Strong hands-on experience in Python for large-scale web scraping and automation.
- Expert in web scraping using Scrapy, BeautifulSoup, Selenium, Playwright, and Requests.
- Excellent understanding of HTML, CSS, DOM structure , and browser-rendered content.
- Experience in backend / API development using FastAPI, Django, or Flask .
- Ability to handle proxies, user-agent rotation, cookies, sessions, and anti-bot mechanisms.
- Strong debugging, error-handling, and optimization skills.
- Ability to independently deliver reliable and scalable data extraction solutions.
Key Responsibilities :
Qualifications :
Create a job alert for this search
Python Developer • surat, gujarat, in
Related jobs
- Promoted
- New!
Senior Python Developer
DBiz.aimohali, gujarat, in Develop and maintain efficient.Write clean, reusable, and optimized.Analyze and understand website structures, implement logic to handle.
Collaborate with backend and data teams to ensure smooth dat...Show moreLast updated: 5 hours ago
- Promoted
- New!
Python Developer
Randstad Digitalsurat, gujarat, in As an Application Designer, you will assist in defining requirements and designing applications to meet business process and application requirements.
A typical day involves collaborating with cross...Show moreLast updated: 5 hours ago
- Promoted
Automation Engineer
SourcebaeSurat, IN Senior Python Automation Engineer / Lead (6+ Yrs) | Selenium, Playwright, CI / CD | Hybrid 🚀.We are seeking a highly experienced and technically strong.
Senior Python Automation Engineer / Lead.This ...Show moreLast updated: 7 days ago
- Promoted
Python Developer
Turingmohali, gujarat, in We’re looking for experienced Python developer to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models think, reason, and ...Show moreLast updated: 13 days ago
- Promoted
Python Developer
PANDIT AIsurat, gujarat, in Immediate Joining Required — 1 week or less.We are looking for a highly skilled.APIs, and integrations for our AI-powered platform.
You will work closely with our engineering team to develop robust,...Show moreLast updated: 1 day ago
- Promoted
Python Developer
Integrated Wireless Solutionsmohali, gujarat, in Collaborate with data scientists and engineers to integrate.Build APIs (REST / GraphQL) to serve data to web and mobile front ends.
Optimize data ingestion, transformation, and processing pipelines to...Show moreLast updated: 30+ days ago
- Promoted
Senior Python Developer
Aarav Solutionsmohali, gujarat, in Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show moreLast updated: 30+ days ago
- Promoted
Python Developer
Cozzerasurat, gujarat, in Job Title : AI Expert + Python Developer.Location : Hybrid (2 days in week at any location – Noida, Gurgaon, Pune, Chennai, Bangalore, Hyderabad, or Indore).
Work Hours : 11 : 00 AM – 9 : 00 PM IST.We are see...Show moreLast updated: 30+ days ago
- Promoted
- New!
Python Developer
Rconnect Tech Incmohali, gujarat, in Minimum 6-8 years of strong hands-on experience using Python.Should have extensive experience in async programming, fast API, unit tests(pytest), Rest APIs.
Exposure and understanding of Devops, mon...Show moreLast updated: 5 hours ago
- Promoted
Python Developer
Embitel Technologiessurat, gujarat, in Job Description : Software Engineer.We are seeking a highly skilled.Python and strong software engineering fundamentals.The ideal candidate will have extensive experience working with object-oriente...Show moreLast updated: 3 days ago
- Promoted
Python Developer
TalentBridgesurat, gujarat, in Senior Software Engineer - Backend.We are seeking a highly skilled and experienced Senior Developer with strong expertise in Python scripting and MySQL to join our team.
The ideal candidate should h...Show moreLast updated: 3 days ago
- Promoted
Python Developer
MyData Insights Pvt Ltdsurat, gujarat, in We are seeking a Python / FastAPI Development Lead with strong expertise in FastAPI to join an exciting Reinforcement Learning (RL) Gym project.
You will design, build, and optimize scalable APIs, col...Show moreLast updated: 1 day ago
- Promoted
Python Developer - 17852
Turingmohali, gujarat, in We’re looking for experienced Python developers to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models think, reason, and...Show moreLast updated: 30+ days ago
- Promoted
Python Developer
Huxleymohali, gujarat, in This team oversees the entire advertising technology ecosystem that powers global ad operations.It is a cross-functional, data-driven organization with members distributed across multiple countries...Show moreLast updated: 2 days ago
- Promoted
Python Developer
GoMLsurat, gujarat, in We are in search of a passionate and skilled Python Developer to join our dynamic team.This role is ideal for someone with a profound expertise in Python and its ecosystem, focused on backend devel...Show moreLast updated: 1 day ago
- Promoted
- New!
Senior Python Developer / Lead Python Developer
Apptadsurat, gujarat, in We are looking for a Python Developer to design and implement enrichment and lookup services for UL (Upstream / Downstream) message processing.
The role requires strong fundamentals in Python and data...Show moreLast updated: 5 hours ago
- Promoted
- New!
Python Developer (Airflow, Cloud)
Luxoftmohali, gujarat, in This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure.
The goal is to enhance data access...Show moreLast updated: 5 hours ago
- Promoted
Python Developer
HonestAI - Building AI Powered Apps & Agentifying Companiessurat, gujarat, in At HonestAI-GrayCyan, we specialize in turning the promise of Artificial Intelligence into practical results.We deliver tailored AI solutions and Agents to build AI-powered SaaS Tech Apps, streamli...Show moreLast updated: 2 days ago