Python Developer (Web Crawling Exp)DBiz.ai • surat, gujarat, in
No longer accepting applications
Python Developer (Web Crawling Exp)
DBiz.ai • surat, gujarat, in
22 hours ago
Job descriptionStrong coding skills in Python . Good understanding of how web pages, HTTP, and crawlers work. Hands-on experience with Docker , Postman , and PowerShell . Basic understanding of HTML , AngularJS , RabbitMQ , and Celery . Experience with Git and Bitbucket for version control and team collaboration. Familiarity with XPath , CSS selectors , and regular expressions for content extraction. Exposure to Scrapy , Puppeteer / Playwright , or other crawling frameworks. Understanding of Elasticsearch , HAProxy , or Curator for large-scale data handling.
Python Developer (Web Crawling Exp) - 5+years - Kochi
Responsibilities :
- Develop and maintain efficient web crawlers with a focus on speed, performance, and scalability .
- Write clean, reusable, and optimized Python code for large-scale data extraction.
- Analyze and understand website structures, implement logic to handle dynamic and JS-rendered pages .
- Troubleshoot and debug crawl issues, optimize request handling, and improve crawler reliability.
- Collaborate with backend and data teams to ensure smooth data flow and integration.
- Monitor crawler performance, logs, and resolve runtime errors.
- Participate in code reviews, documentation, and continuous process improvements.
Skills Required :
Preferred :
Create a job alert for this search
Web Developer • surat, gujarat, in
Related jobs
Back End Developer
Digitalzone • Surat, IN
We are building a new AI-native engineering team that leverages Vibe Coding, a cutting-edge development workflow infused with AI agent pair programming (e.
Claude Code, Cursor AI, GitHub Copilot, Co...Show more
Last updated: 21 days ago • Promoted
Senior Python Developer (Programming)
Jobseekerspage.com • Surat, Gujarat, India
HIRING - SENIOR PYTHON DEVELOPER Role : Senior Python Developer (Programming) Experience : 10+ Years Employment Type : Contract Location : Remote – Pan India Rate : INR 1800 / hr (FIXED) Availabilit...Show more
Last updated: 4 days ago • Promoted
Python Automation & Web Scraping Engineer (2 to 4 yrs)
AIMLEAP • Surat, IN
Python Automation & Web Scraping Engineer (WFH).Bachelor’s degree in Computer Science / Information Technology.Selenium, BeautifulSoup, Requests.
Experience in backend / API development using.Strong s...Show more
Last updated: 2 days ago • Promoted
Senior Python Developer
Aarav Solutions • surat, gujarat, in
Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show more
Last updated: 30+ days ago • Promoted
Web Developer (Freelance)
Sweet • Surat, IN
Sweet is the AI-native business platform built for creators — a business partner that clears the clutter, automates the back-office, and gives creators the freedom to focus on craft, while Sweet gr...Show more
Last updated: 1 day ago • Promoted
Freelance Python Full-Stack Developer (Python • Kafka • Java)
ThreatXIntel • surat, gujarat, in
ThreatXIntel is a startup specializing in cybersecurity services to help businesses and organizations safeguard their digital assets from cyber threats.
Our team offers tailored, cost-effective solu...Show more
Last updated: 22 hours ago • Promoted • New!
Web Crawling Engineer
Forage AI • Surat, IN
The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.
Forage AI is a pioneering A...Show more
Last updated: 14 days ago • Promoted
Backend Developer
Assima • Surat, IN
Assima is a worldwide leader in training, assistance and software adoption for Fortune 500 companies.Our patented technology is trusted by 15 of the top 20 banks, major international organizations ...Show more
Last updated: 3 days ago • Promoted
Web Developer
Smart Moves Consultants • Surat, IN
Design and develop high-performance, responsive web portals using React.Build scalable backend services and APIs with Node.
Integrate and optimize Snowflake for secure data storage, querying, and an...Show more
Last updated: 3 hours ago • Promoted • New!
Python Developer (Web Crawling Exp)
DBiz.ai • surat, India
Python Developer (Web Crawling Exp) - 5+years - Kochi.Develop and maintain efficient.Write clean, reusable, and optimized.
Analyze and understand website structures, implement logic to handle.Collab...Show more
Last updated: 15 hours ago • Promoted • New!
AI Engineer (Backend) - Python
Edstem Technologies • Surat, IN
We are building the next generation of AI-powered applications that deliver actionable financial and marketing insights to our clients.
As an AI Engineer focused on backend development, you'll be in...Show more
Last updated: 7 days ago • Promoted
Senior Python Developer
Huptech HR Solutions • Surat, Gujarat, India
Job Post : - Senior Python Developer Experience 7+ years Location : Remote Responsibilities : Software Development : Write clean, scalable, and efficient Python code to develop software applications...Show more
Last updated: 21 days ago • Promoted
Python Developer
GoML • surat, gujarat, in
We are in search of a passionate and skilled Python Developer to join our dynamic team.This role is ideal for someone with a profound expertise in Python and its ecosystem, focused on backend devel...Show more
Last updated: 5 days ago • Promoted
Python Developer
Tata Consultancy Services • surat, gujarat, in
Required Skillset : Python, OOP, Django, Fast API.Core Python Knowledge, which is most important for any framework.Libraries and Frameworks (eg : Django, FastAPI etc).
At least basic knowledge of depl...Show more
Last updated: 30+ days ago • Promoted
Python Automation Developer - PAN India
Concentrix • mohali, gujarat, in
Looking for Python Expertise with minimum 6+ years of experience with having below must have skills : .Experience in automating business processes using Python.
Integrate bots with databases (SQL, Pos...Show more
Last updated: 22 hours ago • Promoted • New!
Senior Python Developer
HISH IT SERVICES • surat, gujarat, in
Role : Senior Python Developer.Location : Remote(Banglore,Chennai,Pune).Pay : 23LPA - 27 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12...Show more
Last updated: 10 days ago • Promoted
Edifec Developer
NR Consulting • Surat, Gujarat, India
Title - EDIFEC DEVELOPER Total Experience - 4+years Location – Bangalore / HYD / Noida (Remote option available) Notice period – 0-30days Job Description : 1.
Edifecs Edifecs XEngine Server Edifecs Spe...Show more
Last updated: 4 days ago • Promoted
Lead Software Statistician (SDLC, R / Python / Julia and "code repository tools; Jira, Confluence, BitBucket, TestRail")
Cytel • Surat, IN
Lead the development and testing of our innovative and market-leading statistical software.Assist team members on the implementation of complex and innovative statistical algorithms in software pro...Show more
Last updated: 13 days ago • Promoted