Python Developer (Web Crawling Exp)DBiz.ai • lucknow, uttar pradesh, in
No longer accepting applications
Python Developer (Web Crawling Exp)
DBiz.ai • lucknow, uttar pradesh, in
15 hours ago
Job descriptionStrong coding skills in Python . Good understanding of how web pages, HTTP, and crawlers work. Hands-on experience with Docker , Postman , and PowerShell . Basic understanding of HTML , AngularJS , RabbitMQ , and Celery . Experience with Git and Bitbucket for version control and team collaboration. Familiarity with XPath , CSS selectors , and regular expressions for content extraction. Exposure to Scrapy , Puppeteer / Playwright , or other crawling frameworks. Understanding of Elasticsearch , HAProxy , or Curator for large-scale data handling.
Python Developer (Web Crawling Exp) - 5+years - Kochi
Responsibilities :
- Develop and maintain efficient web crawlers with a focus on speed, performance, and scalability .
- Write clean, reusable, and optimized Python code for large-scale data extraction.
- Analyze and understand website structures, implement logic to handle dynamic and JS-rendered pages .
- Troubleshoot and debug crawl issues, optimize request handling, and improve crawler reliability.
- Collaborate with backend and data teams to ensure smooth data flow and integration.
- Monitor crawler performance, logs, and resolve runtime errors.
- Participate in code reviews, documentation, and continuous process improvements.
Skills Required :
Preferred :
Create a job alert for this search
Web Developer • lucknow, uttar pradesh, in
Related jobs
Web Crawling Engineer
Forage AI • Lucknow, IN
The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.
Forage AI is a pioneering A...Show more
Last updated: 13 days ago • Promoted
Senior Python Developer
Aarav Solutions • lucknow, uttar pradesh, in
Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show more
Last updated: 30+ days ago • Promoted
Python Backend Developer
Tata Consultancy Services • Lucknow, Uttar Pradesh, India
Python Developer Greetings from TCS! TCS is hiring for Python Developer Desired Experience Range : 4 - 8 Years Job Location : Bengaluru / Chennai / Hyderabad / Indore / Ahmedabad / Mumbai Required Technic...Show more
Last updated: 8 hours ago • Promoted • New!
Full Stack Web Devoloper
Astroinvite • Lucknow, Uttar Pradesh, India
Full Stack Developer (Shopify + PHP + WordPress) – Immediate Joiner Location : Noida, Sector 58 (Work From Office) Experience : 2–3 Years Industry : E-commerce / Astrology & Gemstones (AstroInvite ...Show more
Last updated: 8 hours ago • Promoted • New!
Python Developer
Tata Consultancy Services • lucknow, uttar pradesh, in
Required Skillset : Python, OOP, Django, Fast API.Core Python Knowledge, which is most important for any framework.Libraries and Frameworks (eg : Django, FastAPI etc).
At least basic knowledge of depl...Show more
Last updated: 30+ days ago • Promoted
Python Developer
MyData Insights Pvt Ltd • Lucknow, Uttar Pradesh, India
We are seeking a Python / FastAPI Development Lead with strong expertise in FastAPI to join an exciting Reinforcement Learning (RL) Gym project.
You will design, build, and optimize scalable APIs, col...Show more
Last updated: 5 days ago • Promoted
Lead Backend Developer (Python)
Zetexa Global • Lucknow, Uttar Pradesh, India
Job description About Us : Zetexa Global Private Limited is a dynamic startup founded by visionary leaders from esteemed institutions like IIT and IIM.
We are at the forefront of reshaping global Tr...Show more
Last updated: 30+ days ago • Promoted
Back End Developer
Digitalzone • Lucknow, IN
We are building a new AI-native engineering team that leverages Vibe Coding, a cutting-edge development workflow infused with AI agent pair programming (e.
Claude Code, Cursor AI, GitHub Copilot, Co...Show more
Last updated: 21 days ago • Promoted
Backend Developer
Assima • Lucknow, IN
Assima is a worldwide leader in training, assistance and software adoption for Fortune 500 companies.Our patented technology is trusted by 15 of the top 20 banks, major international organizations ...Show more
Last updated: 3 days ago • Promoted
Python Developer
eAspire Technolabs Inc. • Lucknow, Uttar Pradesh, India
We Are Hiring : Senior Python Developer + AWS (6+ Years Experience) Location : Kochi / Thiruvananthapuram Work Mode : Onsite for first 3–4 months, then Hybrid Base Location Open to PAN India candida...Show more
Last updated: 20 days ago • Promoted
Python Developer
Talentoj • uttar pradesh, India
A Python Developer is responsible for writing Python code using pre-defined packages for data and machine learning purposes.
They work with frameworks like Pandas, TensorFlow, PyTorch, and Scikit-Le...Show more
Last updated: 1 day ago • Promoted
Python Automation & Web Scraping Engineer (2 to 4 yrs)
AIMLEAP • Lucknow, IN
Python Automation & Web Scraping Engineer (WFH).Bachelor’s degree in Computer Science / Information Technology.Selenium, BeautifulSoup, Requests.
Experience in backend / API development using.Strong s...Show more
Last updated: 1 day ago • Promoted
Senior Python Developer
HISH IT SERVICES • lucknow, uttar pradesh, in
Role : Senior Python Developer.Location : Remote(Banglore,Chennai,Pune).Pay : 23LPA - 27 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12...Show more
Last updated: 10 days ago • Promoted
Python Lead developer
Cognizant • Lucknow, Uttar Pradesh, India
Should have 10+ years of Python development experience Experience with popular Python frameworks such as Django, Flask or Pyramid.
Knowledge of data science and machine learning concepts and tools.A...Show more
Last updated: 8 hours ago • Promoted • New!
Freelance Python Full-Stack Developer (Python • Kafka • Java)
ThreatXIntel • lucknow, uttar pradesh, in
ThreatXIntel is a startup specializing in cybersecurity services to help businesses and organizations safeguard their digital assets from cyber threats.
Our team offers tailored, cost-effective solu...Show more
Last updated: 15 hours ago • Promoted • New!
Freelance Deep Web Crawler Engineer (AI-Integrated Data Pipeline)
Sixteen Alpha AI • lucknow, uttar pradesh, in
The crawler will be integrated with an.AI or NLP / LLM-based components.JavaScript, infinite scrolling, or APIs.LLM-based data labeling, or automated content enrichment modules.Airflow, Prefect, or c...Show more
Last updated: 12 days ago • Promoted
Python Developer
GoML • lucknow, uttar pradesh, in
We are in search of a passionate and skilled Python Developer to join our dynamic team.This role is ideal for someone with a profound expertise in Python and its ecosystem, focused on backend devel...Show more
Last updated: 5 days ago • Promoted
Python Developer (Web Crawling Exp)
DBiz.ai • Lucknow, Uttar Pradesh, India
Python Developer (Web Crawling Exp) - 5+years - Kochi Responsibilities : Develop and maintain efficient web crawlers with a focus on speed, performance, and scalability.Write clean, reusable, an...Show more
Last updated: 8 hours ago • Promoted • New!