Python Developer – Web Scraping & Automation (3 to 5 yrs)
AIMLEAPJunagadh, IN4 days ago
Job descriptionDevelop, optimize, and maintain web scraping scripts and automation pipelines in Python. Extract data from static, dynamic, and JavaScript-heavy websites using browser automation. Manage pagination, authentication of workflows, cookies, sessions , and rendering challenges. Build and maintain REST APIs to support data access and processing. Implement end-to-end pipelines for data cleaning, transformation, and storage (CSV, JSON, DB). Work with SQL / NoSQL databases to store and manage scraped datasets. Use Docker for containerization and deploy scraping tools to cloud environments. Troubleshoot scraping failures, automate recovery, and ensure high data accuracy. Maintain logs, monitoring, and documentation for scraping workflows. Strong programming experience in Python . Proficiency with Scrapy, Beautiful Soup, Selenium, Playwright, and Requests . Understanding HTTP, APIs, headers, cookies, sessions, and web protocols. Experience with backend frameworks : FastAPI / Django / Flask . Experience working with Docker and basic CI / CD workflows is good to have . Knowledge of relational and non-relational databases. Strong debugging, optimization, and troubleshooting abilities.
Python Developer – Web Scraping & Automation (WFH)
Experience : 3-5 Years
Location : Remote
Mode of Engagement : Full-time
No of Positions : 3
Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology
Industry : IT / Software Development
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- Strong hands-on experience in Python for large-scale web scraping and automation.
- Expert in web scraping using Scrapy, BeautifulSoup, Selenium, Playwright, and Requests.
- Excellent understanding of HTML, CSS, DOM structure , and browser-rendered content.
- Experience in backend / API development using FastAPI, Django, or Flask .
- Ability to handle proxies, user-agent rotation, cookies, sessions, and anti-bot mechanisms.
- Strong debugging, error-handling, and optimization skills.
- Ability to independently deliver reliable and scalable data extraction solutions.
Key Responsibilities :
Qualifications :
Create a job alert for this search
Python Developer • Junagadh, IN
Related jobs
- Promoted
- New!
Senior Python Developer
Luxoftjunagadh, gujarat, in We're seeking a strong and creative Software Engineer eager to solve challenging problems of scale and work on cutting edge technologies.
In this project, you will have the opportunity to write code...Show moreLast updated: 19 hours ago
- Promoted
Python Developer
HonestAI - Building AI Powered Apps & Agentifying Companiesjunagadh, gujarat, in At HonestAI-GrayCyan, we specialize in turning the promise of Artificial Intelligence into practical results.We deliver tailored AI solutions and Agents to build AI-powered SaaS Tech Apps, streamli...Show moreLast updated: 2 days ago
- Promoted
- New!
NVIDIA Omniverse Developer
YASH TechnologiesJunagadh, IN NVIDIA Omniverse Developer + Python.We’re developing a next-generation platform powered by.AI technologies to enable immersive.
USD (Universal Scene Description).Integrate real-time data from IoT se...Show moreLast updated: 16 hours ago
- Promoted
Senior Python Developer
Aarav Solutionsjunagadh, gujarat, in Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show moreLast updated: 30+ days ago
- Promoted
- New!
Senior Python Developer / Lead Python Developer
Apptadjunagadh, gujarat, in We are looking for a Python Developer to design and implement enrichment and lookup services for UL (Upstream / Downstream) message processing.
The role requires strong fundamentals in Python and data...Show moreLast updated: 19 hours ago
- Promoted
- New!
Sr. Python Developer
iBase-tjunagadh, gujarat, in Senior Software Engineer (Python Developer).We are looking for a highly skilled Python Developer to join our development team.
This role focuses on building robust, efficient, and scalable backend s...Show moreLast updated: 19 hours ago
- Promoted
Python Developer
MyData Insights Pvt Ltdjunagadh, gujarat, in We are seeking a Python / FastAPI Development Lead with strong expertise in FastAPI to join an exciting Reinforcement Learning (RL) Gym project.
You will design, build, and optimize scalable APIs, col...Show moreLast updated: 1 day ago
- Promoted
Senior / Lead / Principal SDET - Python automation(Storage)
DDNJunagadh, IN This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades.
DataDirect Networks (DDN) is a globa...Show moreLast updated: 4 days ago
- Promoted
Automation Engineer
SourcebaeJunagadh, IN Senior Python Automation Engineer / Lead (6+ Yrs) | Selenium, Playwright, CI / CD | Hybrid 🚀.We are seeking a highly experienced and technically strong.
Senior Python Automation Engineer / Lead.This ...Show moreLast updated: 8 days ago
- Promoted
Senior Python Automation QA
TVS NextJunagadh, IN Participate in the Agile (Scrum) team process, perform required standard testing activities keeping the customer experience top of mind during the testing process.
Build new test automation framewor...Show moreLast updated: 1 day ago
- Promoted
Python Developer
TalentBridgejunagadh, gujarat, in Senior Software Engineer - Backend.We are seeking a highly skilled and experienced Senior Developer with strong expertise in Python scripting and MySQL to join our team.
The ideal candidate should h...Show moreLast updated: 3 days ago
- Promoted
- New!
Python Developer
Rconnect Tech Incjunagadh, gujarat, in Minimum 6-8 years of strong hands-on experience using Python.Should have extensive experience in async programming, fast API, unit tests(pytest), Rest APIs.
Exposure and understanding of Devops, mon...Show moreLast updated: 19 hours ago
- Promoted
- New!
Senior Python Developer
DBiz.aijunagadh, gujarat, in Develop and maintain efficient.Write clean, reusable, and optimized.Analyze and understand website structures, implement logic to handle.
Collaborate with backend and data teams to ensure smooth dat...Show moreLast updated: 19 hours ago
- Promoted
Python Developer
Embitel Technologiesjunagadh, gujarat, in Job Description : Software Engineer.We are seeking a highly skilled.Python and strong software engineering fundamentals.The ideal candidate will have extensive experience working with object-oriente...Show moreLast updated: 3 days ago
- Promoted
- New!
Python Developer
Randstad Digitaljunagadh, gujarat, in As an Application Designer, you will assist in defining requirements and designing applications to meet business process and application requirements.
A typical day involves collaborating with cross...Show moreLast updated: 19 hours ago
- Promoted
- New!
Technical Lead
IncrescoJunagadh, IN Are you a builder who can code, lead, and architect systems that scale — not just maintain them?.At Incresco, we’re pushing boundaries in.
Lead a small squad of top engineers to : .Design modular arch...Show moreLast updated: 20 hours ago
- Promoted
Python Developer
Integrated Wireless Solutionsjunagadh, gujarat, in Collaborate with data scientists and engineers to integrate.Build APIs (REST / GraphQL) to serve data to web and mobile front ends.
Optimize data ingestion, transformation, and processing pipelines to...Show moreLast updated: 30+ days ago
- Promoted
- New!
Python Backend devloper
SuperclaimsJunagadh, IN Backend Developer (AI-Driven, Agentic Workflows).Join Our AI-Powered HealthTech Startup Revolution!.Location : Hyderabad | Full-Time | Salary : Competitive + ESOPs for the right fit.At Superclaims, w...Show moreLast updated: 16 hours ago