Python Web Scraping Engineer – Automation (3 To 10 Yrs)AIMLEAP • Erode, Republic Of India, IN
Python Web Scraping Engineer – Automation (3 To 10 Yrs)
AIMLEAP • Erode, Republic Of India, IN
3 days ago
Job descriptionDevelop and maintain high-scale automated scraping workflows for dynamic and protected websites. Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering. Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms. Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling. Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets. 3–10 years of experience in Python-based web scraping and automation . Strong experience in Selenium, Playwright, Puppeteer , and browser automation. Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy . Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies. Understanding of SQL / NoSQL databases for structured data storage. Experience working with AWS / GCP / Azure is a plus. Strong debugging, analytical, and problem-solving skills.
Python Web Scraping Engineer – Advanced Automation (WFH)
Experience : 3–10 Years
Location : Remote (Work from Home)
Mode of Engagement : Full-time
No of Positions : 8
Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field
Industry : IT / Software Services / Data & AI
Notice Period : Immediate Joiners Preferred
What We Are Looking For
- Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
- Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
- Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
- Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
- Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.
Responsibilities
Qualifications
Create a job alert for this search
Automation Engineer • Erode, Republic Of India, IN
Related jobs
Position - Lead Sr Software Engineer - Python & React.Have 7+ years of industry experience delivering Enterprise products with 3 years in a.
Have experience in building or scaling platforms, APIs, o...Show more
Engineer, GitHub Copilot
Asteya Technologies • Erode, IN
Generative AI & Tool Expertise, including MCP usage and Agentic Orchestration.Expert-level knowledge of GitHub Copilot and Amazon Q features, including Copilot Chat agents and Amazon Q’s / dev comma...Show more
Last updated: 18 days ago • Promoted
Data Engineer - Web Scraping
Alternative Path • Erode, IN
Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show more
Last updated: 30+ days ago • Promoted
Prompt Engineer
Innodata Inc. • Erode, IN
Demonstrated experience programmatically using LLMs to automate data labeling, classification, localization and annotation tasks.
Strong expertise in Python for NLU, for data processing & transforma...Show more
Last updated: 27 days ago • Promoted
AWS Engineer – Ahmedabad (On-Site)
eagerminds • Erode, IN
At EagerMinds, we build modern products at the intersection of AI and AWS, from cost-optimisation agents to compliance automation and AI-powered financial tools.
We move fast, design scalable system...Show more
Last updated: 12 hours ago • Promoted • New!
Senior AI / ML Engineer
Luxoft • Erode, IN
Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process.
We are seeking a highly skilled and innovative Python / AI Engine...Show more
Last updated: 24 days ago • Promoted
Data Engineer
Mastek • Erode, IN
Deep hands-on experience with Unity Catalog — creating and managing catalogs, schemas, and tables.Experience automating data onboarding and metadata registration via Unity Catalog APIs or Databrick...Show more
Last updated: 21 days ago • Promoted
Web Crawling Engineer
Forage AI • Erode, IN
The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.
Forage AI is a pioneering A...Show more
Last updated: 20 days ago • Promoted
Forward Deployed Engineer
Searchability® • Erode, IN
Forward Deployed Engineer - AI💻.Remote-based - relocation to Dubai📍.Searchability MENA is working with an innovative AI startup looking for a.
This is a rare chance to get involved with a company ...Show more
Last updated: 14 days ago • Promoted
Lead Sr Software Engineer Python & React with US IT Product based Co - Remote
Seventh Contact Hiring Solutions • Erode, IN
Remote
Last updated: 30+ days ago • Promoted
Python Web Scraping Engineer – Automation (3 to 10 yrs)
AIMLEAP • Erode, IN
Python Web Scraping Engineer – Advanced Automation (WFH).Bachelor’s degree in Computer Science, IT, or related field .IT / Software Services / Data & AI .
Strong hands-on experience handling.Seleniu...Show more
Last updated: 3 days ago • Promoted
Python Automation Engineer
XpertDox India Pvt Ltd • Erode, IN
Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM).
Familiarity with Windows and Linux fundam...Show more
Last updated: 30+ days ago • Promoted
Senior / Lead / Principal SDET - Python automation(Storage)
DDN • Erode, IN
This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades.
DataDirect Networks (DDN) is a globa...Show more
Last updated: 14 days ago • Promoted
Platform Engineer – Python / Databricks / Notebooks / Kubernetes
Syntasa • Erode, IN
Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited.
This position offers an exciting opportuni...Show more
Last updated: 30+ days ago • Promoted
Python Automation Engineer (RabbitMQ + Azure Cloud)
TekPillar® • Erode, IN
Job Title : Python Automation Engineer (RabbitMQ + Azure Cloud).Build robust automation scripts using.Python, Pytest, and Robot Framework.
Postman / Swagger or equivalent tools.JMeter to identify laten...Show more
Last updated: 12 hours ago • Promoted • New!
Python Automation Developer - PAN India
Concentrix • Erode, IN
Looking for Python Expertise with minimum 6+ years of experience with having below must have skills : .Experience in automating business processes using Python.
Integrate bots with databases (SQL, Pos...Show more
Last updated: 7 days ago • Promoted
DevOps Engineer – Product Infrastructure & Automation | FINJO I972
Omni Recruit Private Limited • Erode, IN
We are looking for a DevOps Engineer with strong knowledge of GitHub, Docker, UNIX scripting, Python (FastAPI), and VMware.
The candidate will be responsible for automating build, deployment, and en...Show more
Last updated: 12 hours ago • Promoted • New!
Generative AI Engineer
Live Connections • Erode, IN
Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred.
ML / Data Science with a focus on generative AI, LLMs, or co...Show more
Last updated: 19 days ago • Promoted
python testing with Gen ai
People Prime Worldwide • Erode, IN
They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation.
We guide customers from what’s now to what’s next by un...Show more
Last updated: 12 hours ago • Promoted • New!