Python Web Scraping Engineer – Automation (3 To 10 Yrs)AIMLEAP • Amritsar, Republic Of India, IN
Python Web Scraping Engineer – Automation (3 To 10 Yrs)
AIMLEAP • Amritsar, Republic Of India, IN
1 day ago
Job descriptionDevelop and maintain high-scale automated scraping workflows for dynamic and protected websites. Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering. Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms. Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling. Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets. 3–10 years of experience in Python-based web scraping and automation . Strong experience in Selenium, Playwright, Puppeteer , and browser automation. Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy . Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies. Understanding of SQL / NoSQL databases for structured data storage. Experience working with AWS / GCP / Azure is a plus. Strong debugging, analytical, and problem-solving skills.
Python Web Scraping Engineer – Advanced Automation (WFH)
Experience : 3–10 Years
Location : Remote (Work from Home)
Mode of Engagement : Full-time
No of Positions : 8
Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field
Industry : IT / Software Services / Data & AI
Notice Period : Immediate Joiners Preferred
What We Are Looking For
- Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
- Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
- Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
- Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
- Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.
Responsibilities
Qualifications
Create a job alert for this search
Automation Engineer • Amritsar, Republic Of India, IN
Related jobs
We are expanding our engineering team and hiring.These are long-term, fully remote freelance roles ideal for developers who want to work on modern front-end stacks, complex UI challenges, and high-...Show more
These long-term, fully remote freelance roles are ideal for engineers with strong hands-on experience in AWS, Azure, or Google Cloud who want to build scalable, secure, high-performance cloud solut...Show more 
Senior Python Automation Engineer - Playwright - (Immediate joiners only)
Innovya Technologies • amritsar, punjab, in
Innovya Technologies is a dynamic and growing software consulting firm that drives business automation with cutting-edge solutions.
We help businesses quickly realize value from their technology and...Show more
Last updated: 18 hours ago • Promoted • New!
AI / ML Engineer
Cozzera • amritsar, punjab, in
We are looking for an experienced AI / ML Engineer with a strong background in machine learning and deep learning, especially in time-series, sensor, and behavioral data.
Strong foundation in ML and d...Show more
Last updated: 18 hours ago • Promoted • New!
Lead Software Engineer
DigiFocal IT Solutions Pvt Ltd • amritsar, punjab, in
Lead Software Engineer (TypeScript | React | Node.We are looking only for Immediate Joiner.Design, develop, and deploy scalable web applications using TypeScript, React, and Node.Collaborate with p...Show more
Last updated: 16 days ago • Promoted
Freelance Senior Data Engineer (ADF • Databricks • Vectr • Cribl)
ThreatXIntel • amritsar, punjab, in
ThreatXIntel is a startup cybersecurity company focused on delivering advanced and tailored solutions to protect businesses and organizations from cyber threats.
Our expertise spans cloud security, ...Show more
Last updated: 18 hours ago • Promoted • New!
Frontend Developers - Fully Remote (Global Software Projects)
SkillsCapital • amritsar, punjab, in
Remote
Last updated: 6 hours ago • Promoted • New!
Generative AI Engineer
Live Connections • amritsar, punjab, in
Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred.
ML / Data Science with a focus on generative AI, LLMs, or co...Show more
Last updated: 17 days ago • Promoted
Senior Python Developer
Huptech HR Solutions • amritsar, punjab, in
Job Description : - Senior Python Developer.Job Location - Ahmedabad (Remote).Software Development : Write clean, scalable, and efficient Python code to develop software applications.Backend Developm...Show more
Last updated: 25 days ago • Promoted
Software Engineer
SnapNfit • amritsar, punjab, in
SnapNfit is one of India’s fastest-growing “fitness at your doorstep” platforms - building premium tech for personal training, physiotherapy, yoga, and more.
We’re expanding our tech team and lookin...Show more
Last updated: 18 hours ago • Promoted • New!
Senior Software Engineer
Programmers.io • amritsar, punjab, in
We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show more
Last updated: 30+ days ago • Promoted
Full Stack Engineer
AideWiser SolTek • amritsar, punjab, in
AWS (EC2, Lambda, S3, RDS, DynamoDB, etc.Design, develop, and maintain backend services using.Net Core / MVC and frontend components using React.
Build and scale backend systems on AWS cloud infrastru...Show more
Last updated: 30+ days ago • Promoted
Software Engineer
ConverzAI • amritsar, punjab, in
Conversational AI solutions in a $500B+ industry.Reinvent how businesses communicate using AI-driven conversations.Our founding team brings deep experience in Cognitive AI (Speech + NLP), holds mul...Show more
Last updated: 18 hours ago • Promoted • New!
Cloud Engineer - Full Remote (Global Cloud-Native Projects)
SkillsCapital • amritsar, punjab, in
Remote
Last updated: 6 hours ago • Promoted • New!
SageMaker Administrator
Digivance Solutions • amritsar, punjab, in
Senior AI Engineer / SageMaker Administrator.Location : Bangalore / Pune / Mysore / Hyderabad.Experience : 8+ years (3+ years relevant in AI Engineering / AWS / SageMaker).
Shift Timing : 10 : 30 AM – 8 : ...Show more
Last updated: 18 hours ago • Promoted • New!
Ai Web Scraping Engineer
Alternative Path • Amritsar, Republic Of India, IN
Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show more
Last updated: 1 day ago • Promoted
Junior Software Engineer
Tilda Research • amritsar, punjab, in
A passion for building scalable AI agents.Build scalable back-end services using.Optimize graph database queries and models in Neo4j.
Collaborate cross-functionally with Product, Engineering, and Cl...Show more
Last updated: 18 hours ago • Promoted • New!
Full Stack Engineer
Programmers.io • amritsar, punjab, in
Job Title : Senior Full Stack Developer (Laravel + Vue).We are seeking highly skilled Senior Full Stack Developers with 7–10 years of experience in Laravel and modern frontend frameworks (Vue.The ca...Show more
Last updated: 15 days ago • Promoted
Javascript Developer
Cognizant • amritsar, punjab, in
Design, develop, and maintain server-side components and APIs using Node.Create and implement RESTful APIs to facilitate communication between the backend and frontend applications.Integrate and in...Show more
Last updated: 17 days ago • Promoted
Data Engineering Manager – Web Crawling & Pipeline Architecture ( 7 to 2 yrs)
AIMLEAP • amritsar, punjab, in
Data Engineering Manager – Web Crawling & Pipeline Architecture.Tech / MCA / Computer Science / IT .IT / Data / AI / E-commerce / FinTech / Healthcare .
Experience working with cloud platforms such ...Show more
Last updated: 18 hours ago • Promoted • New!