No longer accepting applications
Python Developer – Web Scraping & Automation (3 to 5 yrs)
AIMLEAPPrayagraj(Allahabad), IN5 days ago
Job descriptionDevelop, optimize, and maintain web scraping scripts and automation pipelines in Python. Extract data from static, dynamic, and JavaScript-heavy websites using browser automation. Manage pagination, authentication of workflows, cookies, sessions , and rendering challenges. Build and maintain REST APIs to support data access and processing. Implement end-to-end pipelines for data cleaning, transformation, and storage (CSV, JSON, DB). Work with SQL / NoSQL databases to store and manage scraped datasets. Use Docker for containerization and deploy scraping tools to cloud environments. Troubleshoot scraping failures, automate recovery, and ensure high data accuracy. Maintain logs, monitoring, and documentation for scraping workflows. Strong programming experience in Python . Proficiency with Scrapy, Beautiful Soup, Selenium, Playwright, and Requests . Understanding HTTP, APIs, headers, cookies, sessions, and web protocols. Experience with backend frameworks : FastAPI / Django / Flask . Experience working with Docker and basic CI / CD workflows is good to have . Knowledge of relational and non-relational databases. Strong debugging, optimization, and troubleshooting abilities.
Python Developer – Web Scraping & Automation (WFH)
Experience : 3-5 Years
Location : Remote
Mode of Engagement : Full-time
No of Positions : 3
Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology
Industry : IT / Software Development
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- Strong hands-on experience in Python for large-scale web scraping and automation.
- Expert in web scraping using Scrapy, BeautifulSoup, Selenium, Playwright, and Requests.
- Excellent understanding of HTML, CSS, DOM structure , and browser-rendered content.
- Experience in backend / API development using FastAPI, Django, or Flask .
- Ability to handle proxies, user-agent rotation, cookies, sessions, and anti-bot mechanisms.
- Strong debugging, error-handling, and optimization skills.
- Ability to independently deliver reliable and scalable data extraction solutions.
Key Responsibilities :
Qualifications :
Create a job alert for this search
Python Developer • Prayagraj(Allahabad), IN
Related jobs
- Promoted
Web Crawling Engineer
Forage AIPrayagraj(Allahabad), IN The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.
Forage AI is a pioneering A...Show moreLast updated: 11 days ago
- Promoted
WebMethod Developer
MSH IndiaPrayagraj(Allahabad), IN Hiring : Senior webMethods Consultant | 8+ Years Experience | Offshore (India).Join our Integration team as a Senior webMethods Consultant!.
We’re looking for an experienced professional who can desi...Show moreLast updated: 30+ days ago
- Promoted
Python Backend Developer (Immediate joiner)
Origins AI : Helping you build and scalePrayagraj(Allahabad), IN We are a tech-first company solving real-world problems with clean code, thoughtful design, and fast iterations.Our team is lean, product-driven, and obsessed with delivering value through scalable...Show moreLast updated: 30+ days ago
- Promoted
Next JS Developer
Claw LegaltechPrayagraj(Allahabad), IN AI-powered tools that simplify legal workflows.We focus on creating fast, intuitive, and efficient solutions that help legal teams work smarter and save time.
As a growing startup, we value innovati...Show moreLast updated: 2 days ago
- Promoted
AI Web Scraping Engineer
S2T AI - AI-Powered InvestigationsPrayagraj(Allahabad), IN We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show moreLast updated: 30+ days ago
- Promoted
Python Automation Engineer
XpertDox India Pvt LtdPrayagraj(Allahabad), IN Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM).
Familiarity with Windows and Linux fundam...Show moreLast updated: 30+ days ago
- Promoted
Cloud Automation Developer
CentrilogicPrayagraj(Allahabad), IN This role is responsible for designing, developing, and maintaining Infrastructure-as-Code (IaC), automation tooling, and cloud management solutions that support Centrilogic’s managed cloud service...Show moreLast updated: 29 days ago
- Promoted
Online Python Tutor
WiingyPrayagraj(Allahabad), IN Wiingy is a leading online tutoring platform connecting passionate educators with students across the globe.We offer personalized, one-on-one lessons in academic subjects, coding, music, and more.O...Show moreLast updated: 1 day ago
- Promoted
Frontend Developer
GoQuantPrayagraj(Allahabad), IN Front-End Software Engineer (Python / JavaScript).GoQuant Technologies develops innovative solutions that enhance profitability and ease of use for digital asset traders and researchers.Our key produ...Show moreLast updated: 30+ days ago
- Promoted
Senior WordPress & AI Developer (India)
voxfor lifetimePrayagraj(Allahabad), IN We are seeking a highly experienced.AI integrations (C, ML / AI APIs), and Elementor.The ideal candidate will have 6–10 years of proven experience building advanced WordPress solutions, including plu...Show moreLast updated: 30+ days ago
- Promoted
NextJS, NestJS Developer
Sweech Ltd.Prayagraj(Allahabad), IN We are hiring for our own product 'Sherry'.Our website is 'https : / / sherry.Which is innovative service at Anime merchandise area in South Korea.
We have another business area which is System Integrat...Show moreLast updated: 6 days ago
- Promoted
Webflow Developer
goatdevelopers.comPrayagraj(Allahabad), IN From concept to launch, we cover the full spectrum - UI / UX design, backend engineering, AI integration, and frontend development.
Our team has successfully partnered with clients across the globe, d...Show moreLast updated: 1 day ago
- Promoted
Senior / Lead / Principal SDET - Python automation(Storage)
DDNPrayagraj(Allahabad), IN This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades.
DataDirect Networks (DDN) is a globa...Show moreLast updated: 6 days ago
- Promoted
Data Engineer - Web Scraping
Alternative PathPrayagraj(Allahabad), IN Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show moreLast updated: 30+ days ago
- Promoted
Backend Developer
AssimaPrayagraj(Allahabad), IN Assima is a worldwide leader in training, assistance and software adoption for Fortune 500 companies.Our patented technology is trusted by 15 of the top 20 banks, major international organizations ...Show moreLast updated: 1 day ago
- Promoted
AI Engineer (Backend) - Python
Edstem TechnologiesPrayagraj(Allahabad), IN We are building the next generation of AI-powered applications that deliver actionable financial and marketing insights to our clients.
As an AI Engineer focused on backend development, you'll be in...Show moreLast updated: 4 days ago
- Promoted
Forward Deployed Engineer
Searchability®Prayagraj(Allahabad), IN Forward Deployed Engineer - AI💻.Remote-based - relocation to Dubai📍.Searchability MENA is working with an innovative AI startup looking for a.
This is a rare chance to get involved with a company ...Show moreLast updated: 5 days ago
- Promoted
Lead Software Statistician (SDLC, R / Python / Julia and "code repository tools; Jira, Confluence, BitBucket, TestRail")
CytelPrayagraj(Allahabad), IN Lead the development and testing of our innovative and market-leading statistical software.Assist team members on the implementation of complex and innovative statistical algorithms in software pro...Show moreLast updated: 10 days ago