Python Developer – Web Scraping & Automation (3 to 5 yrs)AIMLEAP • Gulbarga, IN
Python Developer – Web Scraping & Automation (3 to 5 yrs)
AIMLEAP • Gulbarga, IN
1 day ago
Job descriptionDevelop, optimize, and maintain web scraping scripts and automation pipelines in Python. Extract data from static, dynamic, and JavaScript-heavy websites using browser automation. Manage pagination, authentication of workflows, cookies, sessions , and rendering challenges. Build and maintain REST APIs to support data access and processing. Implement end-to-end pipelines for data cleaning, transformation, and storage (CSV, JSON, DB). Work with SQL / NoSQL databases to store and manage scraped datasets. Use Docker for containerization and deploy scraping tools to cloud environments. Troubleshoot scraping failures, automate recovery, and ensure high data accuracy. Maintain logs, monitoring, and documentation for scraping workflows. Strong programming experience in Python . Proficiency with Scrapy, Beautiful Soup, Selenium, Playwright, and Requests . Understanding HTTP, APIs, headers, cookies, sessions, and web protocols. Experience with backend frameworks : FastAPI / Django / Flask . Experience working with Docker and basic CI / CD workflows is good to have . Knowledge of relational and non-relational databases. Strong debugging, optimization, and troubleshooting abilities.
Python Developer – Web Scraping & Automation (WFH)
Experience : 3-5 Years
Location : Remote
Mode of Engagement : Full-time
No of Positions : 3
Educational Qualifications : Bachelor’s degree in Computer Science / Information Technology
Industry : IT / Software Development
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- Strong hands-on experience in Python for large-scale web scraping and automation.
- Expert in web scraping using Scrapy, BeautifulSoup, Selenium, Playwright, and Requests.
- Excellent understanding of HTML, CSS, DOM structure , and browser-rendered content.
- Experience in backend / API development using FastAPI, Django, or Flask .
- Ability to handle proxies, user-agent rotation, cookies, sessions, and anti-bot mechanisms.
- Strong debugging, error-handling, and optimization skills.
- Ability to independently deliver reliable and scalable data extraction solutions.
Key Responsibilities :
Qualifications :
Create a job alert for this search
Python Developer • Gulbarga, IN
Related jobs
Web Crawling Engineer
Forage AI • Gulbarga, IN
The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.
Forage AI is a pioneering A...Show more
Last updated: 7 days ago • Promoted
Python Developer - Test Automation
Flexing It® • Gulbarga, IN
Our Client, a Leading Global Specialist in Energy Management and Automation is seeking a highly skilled Python Developer to join our team, focusing on test automation.
In this role, you will be resp...Show more
Last updated: 10 hours ago • Promoted • New!
Xpertdoc developer
NeerInfo Solutions • Gulbarga, IN
Collaborate with business analysts to review and validate Business Requirement Documents.Build and optimize templates using Xpertdoc Template Designer.
Configure Smart Flows for automated document g...Show more
Last updated: 10 hours ago • Promoted • New!
Cloud Automation Developer
Centrilogic • Gulbarga, IN
This role is responsible for designing, developing, and maintaining Infrastructure-as-Code (IaC), automation tooling, and cloud management solutions that support Centrilogic’s managed cloud service...Show more
Last updated: 25 days ago • Promoted
AI Web Scraping Engineer
S2T AI - AI-Powered Investigations • Gulbarga, IN
We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more
Last updated: 30+ days ago • Promoted
Python Backend developer
Droisys • Gulbarga, IN
Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution.
We leverage deep technical expertise, Agil...Show more
Last updated: 16 hours ago • Promoted • New!
Data Engineer - Web Scraping
Alternative Path • Gulbarga, IN
Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show more
Last updated: 30+ days ago • Promoted
Backend Python Developer (2–3 Years)
Delta International Institute • Gulbarga, IN
Join our backend team to architect and scale low-latency FX trading services.PostgreSQL, and engineer an idempotent stream.
Develop & maintain FastAPI microservices (auth, market ingestion, order fl...Show more
Last updated: 30+ days ago • Promoted
Generative AI Python Senior Specialist
Coforge • Gulbarga, IN
Generative AI Python Senior Specialist.Python Senior Specialist to design and implement AI / ML and GenAI solutions.The ideal candidate will have strong programming and statistical skills, with hands...Show more
Last updated: 30+ days ago • Promoted
AI Engineer (Backend) - Python
Edstem Technologies • Gulbarga, IN
We are building the next generation of AI-powered applications that deliver actionable financial and marketing insights to our clients.
As an AI Engineer focused on backend development, you'll be in...Show more
Last updated: 16 hours ago • Promoted • New!
Software Tech Lead(Python)
Gamyam • Gulbarga, IN
Gamyam Info Tech LLP is looking for a.Location : Hyderabad / Razole (Onsite).Take complete ownership of modules and features—from.
Collaborate with cross-functional teams to design & implement new feat...Show more
Last updated: 16 hours ago • Promoted • New!
Python Automation Developer
Tata Technologies • Gulbarga, IN
Proficiency in Python (Advanced level).C Programming (Intermediate level).Experience with Shell Scripting.Familiarity with Linux Environment (Command based).
Hands-on experience with Github.Show more
Last updated: 16 hours ago • Promoted • New!
Web Scraping Engineer
noon • Gulbarga, IN
Job title : Web Scraping Engineer.The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.Develop and...Show more
Last updated: 16 hours ago • Promoted • New!
Python Automation Engineer
XpertDox India Pvt Ltd • Gulbarga, IN
Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM).
Familiarity with Windows and Linux fundam...Show more
Last updated: 30+ days ago • Promoted
Web Developer – Vue.js, Node.js| SEO, AEO & Website Optimization
Credence Data • Gulbarga, IN
SEO, AEO & Website Optimization.Credence provides global business intelligence solutions to the international trade industry, empowering businesses and financial institutions with timely access to ...Show more
Last updated: 16 hours ago • Promoted • New!
Senior / Lead / Principal SDET - Python automation(Storage)
DDN • Gulbarga, IN
This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades.
DataDirect Networks (DDN) is a globa...Show more
Last updated: 1 day ago • Promoted
Webflow Developer
Summit Tech.au • Gulbarga, IN
Summit Tech is an Australian technology agency dedicated to providing affordable and innovative online solutions for enterprise companies.
Based in Australia, Summit Tech combines cutting-edge techn...Show more
Last updated: 10 hours ago • Promoted • New!
Senior Web Scraping Engineer
Zomunk • Gulbarga, IN
We're building a product that relies heavily on collecting structured data from a number of known websites.We need someone experienced who can own this part of the system end-to-end; from writing s...Show more
Last updated: 16 hours ago • Promoted • New!