Python Web Scraping Engineer – Automation (3 to 10 yrs)AIMLEAP • Belgaum, IN
Python Web Scraping Engineer – Automation (3 to 10 yrs)
AIMLEAP • Belgaum, IN
6 hours ago
Job descriptionDevelop and maintain high-scale automated scraping workflows for dynamic and protected websites. Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering. Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms. Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling. Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets. 3–10 years of experience in Python-based web scraping and automation . Strong experience in Selenium, Playwright, Puppeteer , and browser automation. Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy . Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies. Understanding of SQL / NoSQL databases for structured data storage. Experience working with AWS / GCP / Azure is a plus. Strong debugging, analytical, and problem-solving skills.
Python Web Scraping Engineer – Advanced Automation (WFH)
Experience : 3–10 Years
Location : Remote (Work from Home)
Mode of Engagement : Full-time
No of Positions : 8
Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field
Industry : IT / Software Services / Data & AI
Notice Period : Immediate Joiners Preferred
What We Are Looking For
- Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
- Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
- Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
- Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
- Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.
Responsibilities
Qualifications
Create a job alert for this search
Automation Engineer • Belgaum, IN
Related jobs
Tech (Computer Science or related fields).We are seeking a highly skilled and experienced.The ideal candidate must have strong expertise in.
Python, Playwright, PyTest, Pywinauto.API automation (Res...Show more
This is a hands-on engineering role focused on building and maintaining AI and ML services on AWS.You will help turn ideas and prototypes into robust, production-ready APIs and ML flows using Amazo...Show more
Backend Python Engineer - 17852
Turing • Belgaum, IN
We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models think, reason, and ...Show more
Last updated: 23 days ago • Promoted
AI Web Scraping Engineer
S2T AI - AI-Powered Investigations • Belgaum, IN
We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more
Last updated: 30+ days ago • Promoted
Generative AI Engineer
Live Connections • Belgaum, IN
Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred.
ML / Data Science with a focus on generative AI, LLMs, or co...Show more
Last updated: 16 days ago • Promoted
Web Crawling Engineer
Forage AI • Belgaum, IN
The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.
Forage AI is a pioneering A...Show more
Last updated: 17 days ago • Promoted
Data Engineer - Web Scraping
Alternative Path • Belgaum, IN
Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show more
Last updated: 30+ days ago • Promoted
Python Automation Engineer
XpertDox India Pvt Ltd • Belgaum, IN
Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM).
Familiarity with Windows and Linux fundam...Show more
Last updated: 30+ days ago • Promoted
Python Automation Developer - PAN India
Concentrix • Belgaum, IN
Looking for Python Expertise with minimum 6+ years of experience with having below must have skills : .Experience in automating business processes using Python.
Integrate bots with databases (SQL, Pos...Show more
Last updated: 4 days ago • Promoted
Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)
AIMLEAP • Belgaum, IN
Python / JavaScript Developer – Web Scraping - 4 to 7 years.Bachelor's degree in Computer Science, Information Technology.
Strong expertise in web scraping with hands-on experience in large-scale data...Show more
Last updated: 30+ days ago • Promoted
Senior AI / ML Engineer
Luxoft • Belgaum, IN
Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process.
We are seeking a highly skilled and innovative Python / AI Engine...Show more
Last updated: 21 days ago • Promoted
Senior Web Scraping Engineer
Zomunk • Belgaum, IN
We're building a product that relies heavily on collecting structured data from a number of known websites.We need someone experienced who can own this part of the system end-to-end; from writing s...Show more
Last updated: 10 days ago • Promoted
Web & Product Engineer
Kapable • Belgaum, IN
Kapable is a leadership transformation platform helping CXOs, founders, and senior professionals from top global companies become better leaders through our “Thinkable, Speakable, Workable” program...Show more
Last updated: 6 hours ago • Promoted • New!
QA Automation Engineer - Python | Exp 5–8 Years | Full Time - Remote | Shift Timing : 4 PM – 1 AM IST | Immediate Joiner (30 Days)
Unicorn Workforce • Belgaum, IN
Remote
Last updated: 1 day ago • Promoted
AI Engineer (Backend) - Python
Edstem Technologies • Belgaum, IN
We are building the next generation of AI-powered applications that deliver actionable financial and marketing insights to our clients.
As an AI Engineer focused on backend development, you'll be in...Show more
Last updated: 10 days ago • Promoted
AWS AI / ML Engineer (Remote)
Mindcraft Labs • Belgaum, IN
Remote
Last updated: 1 day ago • Promoted
Senior Python / / AI Engineer
Luxoft • Belgaum, IN
Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process.
We are seeking a highly skilled and innovative Python / AI Engine...Show more
Last updated: 3 days ago • Promoted
Senior / Lead / Principal SDET - Python automation(Storage)
DDN • Belgaum, IN
This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades.
DataDirect Networks (DDN) is a globa...Show more
Last updated: 11 days ago • Promoted
Forward Deployed Engineer
Searchability® • Belgaum, IN
Forward Deployed Engineer - AI💻.Remote-based - relocation to Dubai📍.Searchability MENA is working with an innovative AI startup looking for a.
This is a rare chance to get involved with a company ...Show more
Last updated: 11 days ago • Promoted
Quality Engineer (Python robot)
ACL Digital • Belgaum, IN
Python + Robot framework+ API Testing.Should be able to understand and translate a given requirement / Test plan into automation script.
Should be able to do UI and DB testing.Ability to work proactiv...Show more
Last updated: 6 hours ago • Promoted • New!