Python Automation & Web Scraping Engineer (2 to 4 yrs)AIMLEAP • Pune, IN
Python Automation & Web Scraping Engineer (2 to 4 yrs)
AIMLEAP • Pune, IN
1 day ago
Job descriptionDevelop, maintain, and optimize Python-based scraping scripts and automation pipelines . Extract data from both static and dynamic websites, including sites requiring browser automation. Manage pagination, login / authentication , and session-based scraping workflows. Build and maintain REST APIs using Flask / Django to integrate data and automation services. Implement data pipelines for cleaning, transforming, and storing outputs (CSV, Excel, JSON, DB). Work with MySQL, PostgreSQL, MongoDB, Redis for structured and unstructured data storage. Use Docker for containerizing automation modules and assist in basic cloud deployments. Troubleshoot failures, implement retry / recovery logic, and ensure high accuracy of extracted data. Maintain documentation, logging, and monitoring for all scraping and automation tasks. Solid programming experience in Python . Hands-on experience with Selenium, BeautifulSoup, Requests (Playwright / Scrapy optional but good to have). Understanding of HTTP, APIs, headers, cookies, sessions , and basic browser automation concepts. Experience with backend frameworks like Flask or Django . Familiarity with Docker and Git-based workflows. Knowledge of relational and non-relational databases (MySQL / PostgreSQL / MongoDB / Redis). Strong debugging, optimization, and troubleshooting abilities.
Python Automation & Web Scraping Engineer (WFH)
Experience : 2–4 Years
Location : Remote
Mode of Engagement : Full-time
No of Positions : 3
Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology
Industry : IT / Software Development
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- Strong hands-on experience in Python for automation and mid-scale web scraping projects.
- Experience with Selenium, BeautifulSoup, Requests , and automation-driven scraping workflows.
- Good understanding of HTML, CSS, DOM structures , and dynamic / JavaScript-rendered websites.
- Experience in backend / API development using Flask or Django .
- Ability to handle cookies, sessions, authentication flows, headers , and basic anti-bot mechanisms.
- Strong skills in debugging, error handling, data cleaning, and optimization of scraping pipelines.
Key Responsibilities :
Qualifications :
Create a job alert for this search
Automation Engineer • Pune, IN
Related jobs
Software Engineer, Python Automation - QAC (PG)
Confidential • Pune, India
Perforce is a community of collaborative experts, problem solvers, and possibility seekers who believe work should be both challenging and fun.
We are proud to inspire creativity, foster belonging, ...Show more
Last updated: 11 days ago • Promoted
Software Engineer-Python Web scraping
NielsenIQ • Pune, Maharashtra, India
NIQ Digital Shelf is one of Europes fastest-growing companies in the Retail Analytics space.Every day we collect and process over 60 billion data points from web and mobile sources to power real-ti...Show more
Last updated: 12 days ago • Promoted
Automation and Reporting Engineer
Confidential • Pune, India
Are you a proactive, hands-on DevOps Engineer who thrives on connecting.We're looking for someone who's passionate about building smart, scalable solutions that drive real impact.In this role, you'...Show more
Last updated: 22 days ago • Promoted
Python Developer - Web Scraping
Upgrad Rekrut Pvt. Ltd. • Pune
Python+ Web scrapping and responsibilities : - Develop and maintain web scraping and crawling solutions to extract data from various sources.Write efficient Python sc...Show more
Last updated: 13 days ago • Promoted
Python Automation Engineer
Confidential • Pune, India
Senior Python Automation Engineer.Experience Required : 7 to 12 Years | Location : Indore CITP, Pune - Baner, Pune - Viman Nagar.
Collaborate with development teams to enhance application quality thro...Show more
Last updated: 24 days ago • Promoted
Python automation engineer
ACL Digital • Pune, Maharashtra, India
Bachelor's degree in Electrical Engineering, or a related field (or equivalent work experience).Python Automation Engineer or similar role with exposure to Pandas.
Strong understanding of statistica...Show more
Last updated: 20 days ago • Promoted
Web Crawling Engineer
Forage AI • Pune, IN
The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.
Forage AI is a pioneering A...Show more
Last updated: 13 days ago • Promoted
AI Web Scraping Engineer
S2T AI - AI-Powered Investigations • Pune, IN
We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more
Last updated: 30+ days ago • Promoted
Python automation engineer
Confidential • Pune, India
Bachelor's degree in Electrical Engineering, or a related field (or equivalent work experience).Python Automation Engineer or similar role with exposure to Pandas.
Strong understanding of statistica...Show more
Last updated: 24 days ago • Promoted
Senior Automation Engineer
Confidential • Pune
Programming experience with Go or Python.Experience working with CI / CD (any of Jenkins, CircleCI, GitHub actions).Experience with API Automation and framework development.Strong knowledge and hand-...Show more
Last updated: 30+ days ago • Promoted
Ansible & Python Automation Engineer
Confidential • Pune
Required Skills and Experience : .Strong proficiency in Ansible, Python, and PowerShell scripting.Experience with Infrastructure as Code (IaC) tools like Terraform or CloudFormation.Knowledge of conf...Show more
Last updated: 30+ days ago • Promoted
Web Scraper Developer
Confidential • Pune, India
HEROIC Cybersecurity ( HEROIC.Web Scraper Developer with deep expertise in building scalable, automated web data collection systems to power our AI-driven cybersecurity intelligence platforms.You ...Show more
Last updated: 12 days ago • Promoted
Python Automation Engineer
XpertDox India Pvt Ltd • Pune, IN
Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM).
Familiarity with Windows and Linux fundam...Show more
Last updated: 30+ days ago • Promoted
Python Automation Developer - PAN India
Concentrix • pune, maharashtra, in
Looking for Python Expertise with minimum 6+ years of experience with having below must have skills : .Experience in automating business processes using Python.
Integrate bots with databases (SQL, Pos...Show more
Last updated: 6 hours ago • Promoted • New!
Python Automation Engineer (SDET)
Confidential • Pune
Bachelors degree in computer science, Engineering, or related field.Expertise in Python programming language with a deep understanding of object[1]oriented programming concepts and design patterns....Show more
Last updated: 30+ days ago • Promoted
Data Engineer - Web Scraping
Alternative Path • Pune, IN
Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show more
Last updated: 30+ days ago • Promoted
Aligned Automation - Full Stack Developer - Python / Flask
Aligned Automation • Pune
Description : Job description - Full Stack Developers (Python + SQL + React) About Aligned Automation : &l...Show more
Last updated: 30+ days ago • Promoted
Automation Engineer (Python)
Confidential • Pune
Design and develop scalable Python scripts for task and process automation.Build Flask-based APIs to enable cross-application integrations.
Write and manage SQL queries and support Oracle DB interac...Show more
Last updated: 30+ days ago • Promoted