Python Developer – Web Scraping & Automation (3 to 5 yrs)AIMLEAP • Kanpur, IN
No longer accepting applications
Python Developer – Web Scraping & Automation (3 to 5 yrs)
AIMLEAP • Kanpur, IN
8 days ago
Job descriptionDevelop, optimize, and maintain web scraping scripts and automation pipelines in Python. Extract data from static, dynamic, and JavaScript-heavy websites using browser automation. Manage pagination, authentication of workflows, cookies, sessions , and rendering challenges. Build and maintain REST APIs to support data access and processing. Implement end-to-end pipelines for data cleaning, transformation, and storage (CSV, JSON, DB). Work with SQL / NoSQL databases to store and manage scraped datasets. Use Docker for containerization and deploy scraping tools to cloud environments. Troubleshoot scraping failures, automate recovery, and ensure high data accuracy. Maintain logs, monitoring, and documentation for scraping workflows. Strong programming experience in Python . Proficiency with Scrapy, Beautiful Soup, Selenium, Playwright, and Requests . Understanding HTTP, APIs, headers, cookies, sessions, and web protocols. Experience with backend frameworks : FastAPI / Django / Flask . Experience working with Docker and basic CI / CD workflows is good to have . Knowledge of relational and non-relational databases. Strong debugging, optimization, and troubleshooting abilities.
Python Developer – Web Scraping & Automation (WFH)
Experience : 3-5 Years
Location : Remote
Mode of Engagement : Full-time
No of Positions : 3
Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology
Industry : IT / Software Development
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- Strong hands-on experience in Python for large-scale web scraping and automation.
- Expert in web scraping using Scrapy, BeautifulSoup, Selenium, Playwright, and Requests.
- Excellent understanding of HTML, CSS, DOM structure , and browser-rendered content.
- Experience in backend / API development using FastAPI, Django, or Flask .
- Ability to handle proxies, user-agent rotation, cookies, sessions, and anti-bot mechanisms.
- Strong debugging, error-handling, and optimization skills.
- Ability to independently deliver reliable and scalable data extraction solutions.
Key Responsibilities :
Qualifications :
Create a job alert for this search
Python Developer • Kanpur, IN
Related jobs
Web Developer
BID.ai • Kanpur, Uttar Pradesh, India
About the job Job Title : Web Developer Intern(Full Stack) Location : Prayagraj, Uttar Pradesh (Remote during probation, On-site post-confirmation) Job Typ e : 6-Month Internship (Performance...Show more
Last updated: 1 day ago • Promoted
Web Crawling Engineer
Forage AI • Kanpur, IN
The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.
Forage AI is a pioneering A...Show more
Last updated: 14 days ago • Promoted
Python Full Stack Developer
Luxoft • kanpur, uttar pradesh, in
We need an experienced Python Developer to work for a leading investment bank client.Design, develop, and maintain full-stack Python applications with modern frontend frameworks.Build and optimize ...Show more
Last updated: 3 hours ago • Promoted • New!
Senior Python Developer
Aarav Solutions • kanpur, uttar pradesh, in
Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show more
Last updated: 30+ days ago • Promoted
Data Engineer - Web Scraping
Alternative Path • Kanpur, IN
Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show more
Last updated: 30+ days ago • Promoted
Senior Python Developer
HISH IT SERVICES • kanpur, uttar pradesh, in
Role : Senior Python Developer.Location : Remote(Banglore,Chennai,Pune).Pay : 23LPA - 27 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12...Show more
Last updated: 11 days ago • Promoted
Python Developer
GoML • Kanpur, Uttar Pradesh, India
We are in search of a passionate and skilled Python Developer to join our dynamic team.This role is ideal for someone with a profound expertise in Python and its ecosystem, focused on backend devel...Show more
Last updated: 5 days ago • Promoted
Python Automation & Web Scraping Engineer (2 to 4 yrs)
AIMLEAP • Kanpur, IN
Python Automation & Web Scraping Engineer (WFH).Bachelor’s degree in Computer Science / Information Technology.Selenium, BeautifulSoup, Requests.
Experience in backend / API development using.Strong s...Show more
Last updated: 2 days ago • Promoted
AI Web Scraping Engineer
S2T AI - AI-Powered Investigations • Kanpur, IN
We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more
Last updated: 30+ days ago • Promoted
Python Automation Developer - PAN India
Concentrix • Kanpur, IN
Looking for Python Expertise with minimum 6+ years of experience with having below must have skills : .Experience in automating business processes using Python.
Integrate bots with databases (SQL, Pos...Show more
Last updated: 1 day ago • Promoted
Python Developer
Tata Consultancy Services • kanpur, uttar pradesh, in
Required Skillset : Python, OOP, Django, Fast API.Core Python Knowledge, which is most important for any framework.Libraries and Frameworks (eg : Django, FastAPI etc).
At least basic knowledge of depl...Show more
Last updated: 30+ days ago • Promoted
Senior Backend Developer
Confidential • Kanpur, India
Confidential (based on experience).Full Time Permanent position(Payroll and Compliance to be managed by : ScaleXP).Note : This is a requirement for one of Uplers' client - A UK-based Finance Analytic...Show more
Last updated: 17 days ago • Promoted
Python Developer – Gen AI & Agentic Frameworks
RapidBrains • kanpur, uttar pradesh, in
We are looking for a skilled Python Developer with strong software engineering fundamentals and hands-on experience in building applications using Generative AI and agent-based frameworks.The ideal...Show more
Last updated: 3 hours ago • Promoted • New!
Python Developer
Talentoj • Kanpur, Uttar Pradesh, India
JOB DESCRIPTION Position- Developer Function- Delivery Technology- Python Experience- 3-5 years ROLE & RESPONSIBILITIES : A Python Developer is responsible for writing Python code using pre-def...Show more
Last updated: 1 day ago • Promoted
Python Automation Engineer
XpertDox India Pvt Ltd • Kanpur, IN
Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM).
Familiarity with Windows and Linux fundam...Show more
Last updated: 30+ days ago • Promoted
Project Lead
Beroe Inc • Kanpur, Uttar Pradesh, India
About the Role We are seeking an accomplished Project Lead – Python & AI Developer to lead end-to-end delivery of AI-powered analytics and product development initiatives.The ideal candidate is ...Show more
Last updated: 1 day ago • Promoted
Senior Python Developer
Rapid Innovation • kanpur, uttar pradesh, in
Job Title : Senior Python Developer (5–6 Years Experience).We are looking for an experienced Senior Python Developer who can design, build, and optimise scalable backend systems.You will work closel...Show more
Last updated: 3 hours ago • Promoted • New!
AI Engineer (Backend) - Python
Edstem Technologies • Kanpur, IN
We are building the next generation of AI-powered applications that deliver actionable financial and marketing insights to our clients.
As an AI Engineer focused on backend development, you'll be in...Show more
Last updated: 7 days ago • Promoted