Python Developer – Web Scraping & Automation (3 to 5 yrs)AIMLEAP • Guntur, IN
Python Developer – Web Scraping & Automation (3 to 5 yrs)
AIMLEAP • Guntur, IN
1 day ago
Job descriptionDevelop, optimize, and maintain web scraping scripts and automation pipelines in Python. Extract data from static, dynamic, and JavaScript-heavy websites using browser automation. Manage pagination, authentication of workflows, cookies, sessions , and rendering challenges. Build and maintain REST APIs to support data access and processing. Implement end-to-end pipelines for data cleaning, transformation, and storage (CSV, JSON, DB). Work with SQL / NoSQL databases to store and manage scraped datasets. Use Docker for containerization and deploy scraping tools to cloud environments. Troubleshoot scraping failures, automate recovery, and ensure high data accuracy. Maintain logs, monitoring, and documentation for scraping workflows. Strong programming experience in Python . Proficiency with Scrapy, Beautiful Soup, Selenium, Playwright, and Requests . Understanding HTTP, APIs, headers, cookies, sessions, and web protocols. Experience with backend frameworks : FastAPI / Django / Flask . Experience working with Docker and basic CI / CD workflows is good to have . Knowledge of relational and non-relational databases. Strong debugging, optimization, and troubleshooting abilities.
Python Developer – Web Scraping & Automation (WFH)
Experience : 3-5 Years
Location : Remote
Mode of Engagement : Full-time
No of Positions : 3
Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology
Industry : IT / Software Development
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- Strong hands-on experience in Python for large-scale web scraping and automation.
- Expert in web scraping using Scrapy, BeautifulSoup, Selenium, Playwright, and Requests.
- Excellent understanding of HTML, CSS, DOM structure , and browser-rendered content.
- Experience in backend / API development using FastAPI, Django, or Flask .
- Ability to handle proxies, user-agent rotation, cookies, sessions, and anti-bot mechanisms.
- Strong debugging, error-handling, and optimization skills.
- Ability to independently deliver reliable and scalable data extraction solutions.
Key Responsibilities :
Qualifications :
Create a job alert for this search
Python Developer • Guntur, IN
Related jobs
Web Crawling Engineer
Forage AI • Vijayawada, IN
The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.
Forage AI is a pioneering A...Show more
Last updated: 7 days ago • Promoted
Python Automation Engineer
XpertDox India Pvt Ltd • Vijayawada, IN
Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM).
Familiarity with Windows and Linux fundam...Show more
Last updated: 30+ days ago • Promoted
Python Developer
Thoughtworks • guntur, andhra pradesh, in
Diversity Req-Female candidates only).Senior Software Developers collaborate with Business and Quality Analysts, Designers, Project Managers and more to design software solutions that will create m...Show more
Last updated: 17 hours ago • Promoted • New!
Python Developer
SystemBender • vijayawada, andhra pradesh, in
API development for a modern cloud-based application.This role requires a technically strong engineer with deep expertise in Python and hands-on experience in C#, Azure, and microservices architect...Show more
Last updated: 12 days ago • Promoted
Senior Web Scraping Engineer
Zomunk • Guntur, IN
We're building a product that relies heavily on collecting structured data from a number of known websites.We need someone experienced who can own this part of the system end-to-end; from writing s...Show more
Last updated: 17 hours ago • Promoted • New!
Python Developer - Test Automation
Flexing It® • Guntur, IN
Our Client, a Leading Global Specialist in Energy Management and Automation is seeking a highly skilled Python Developer to join our team, focusing on test automation.
In this role, you will be resp...Show more
Last updated: 11 hours ago • Promoted • New!
Python Backend Developer
Tredence Inc. • vijayawada, andhra pradesh, in
Design, develop, and deploy scalable backend services and APIs using.Architect and implement cloud-native solutions on.EC2, Lambda, S3, RDS, ECS, etc.
Optimize application performance and ensure hig...Show more
Last updated: 10 days ago • Promoted
Python Developer
Huxley • guntur, andhra pradesh, in
This team oversees the entire advertising technology ecosystem that powers global ad operations.It is a cross-functional, data-driven organization with members distributed across multiple countries...Show more
Last updated: 16 hours ago • Promoted • New!
Web Scraping Engineer
noon • Vijayawada, IN
Job title : Web Scraping Engineer.The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.Develop and...Show more
Last updated: 17 hours ago • Promoted • New!
Senior / Lead / Principal SDET - Python automation(Storage)
DDN • Guntur, IN
This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades.
DataDirect Networks (DDN) is a globa...Show more
Last updated: 1 day ago • Promoted
Python Developer
BotLab Dynamics • vijayawada, andhra pradesh, in
We are looking for a passionate Python Developer to join our dynamic team.If you are eager to work on impactful projects and grow in a technology-driven environment, this role is for you!.Develop, ...Show more
Last updated: 17 hours ago • Promoted • New!
Python Developer
Hellowork Consultants • vijayawada, andhra pradesh, in
Python Developer (with AWS Exposure and workflow).We are seeking a Python Developer with strong expertise in Python programming and practical exposure to AWS cloud services.The ideal candidate will...Show more
Last updated: 17 hours ago • Promoted • New!
Python Backend developer
Droisys • Vijayawada, IN
Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution.
We leverage deep technical expertise, Agil...Show more
Last updated: 17 hours ago • Promoted • New!
Python Automation Developer
Tata Technologies • Guntur, IN
Proficiency in Python (Advanced level).C Programming (Intermediate level).Experience with Shell Scripting.Familiarity with Linux Environment (Command based).
Hands-on experience with Github.Show more
Last updated: 17 hours ago • Promoted • New!
Senior Python Developer
Syscore • guntur, andhra pradesh, in
Syscore collaborates with global brands in advancing sustainability, wellness, and social good by designing innovative systems, simplifying complexity, and bringing visionary ideas to life.Combinin...Show more
Last updated: 17 hours ago • Promoted • New!
AI Web Scraping Engineer
S2T AI - AI-Powered Investigations • Vijayawada, IN
We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more
Last updated: 30+ days ago • Promoted
Python Developer
HonestAI - Building AI Powered Apps & Agentifying Companies • vijayawada, andhra pradesh, in
At HonestAI-GrayCyan, we specialize in turning the promise of Artificial Intelligence into practical results.We deliver tailored AI solutions and Agents to build AI-powered SaaS Tech Apps, streamli...Show more
Last updated: 17 hours ago • Promoted • New!
Python Developer
Netra Labs • vijayawada, andhra pradesh, in
Netra Labs redefines enterprise AI with Ground Truth , a platform that transforms expertise into powerful AI agents.This technology allows businesses to create digital twins that automate complex t...Show more
Last updated: 16 hours ago • Promoted • New!