Python Web Scraping Engineer – Automation (3 To 10 Yrs)AIMLEAP • Guwahati, Republic Of India, IN
Python Web Scraping Engineer – Automation (3 To 10 Yrs)
AIMLEAP • Guwahati, Republic Of India, IN
1 day ago
Job descriptionDevelop and maintain high-scale automated scraping workflows for dynamic and protected websites. Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering. Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms. Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling. Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets. 3–10 years of experience in Python-based web scraping and automation . Strong experience in Selenium, Playwright, Puppeteer , and browser automation. Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy . Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies. Understanding of SQL / NoSQL databases for structured data storage. Experience working with AWS / GCP / Azure is a plus. Strong debugging, analytical, and problem-solving skills.
Python Web Scraping Engineer – Advanced Automation (WFH)
Experience : 3–10 Years
Location : Remote (Work from Home)
Mode of Engagement : Full-time
No of Positions : 8
Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field
Industry : IT / Software Services / Data & AI
Notice Period : Immediate Joiners Preferred
What We Are Looking For
- Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
- Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
- Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
- Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
- Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.
Responsibilities
Qualifications
Create a job alert for this search
Automation Engineer • Guwahati, Republic Of India, IN
Related jobs
These long-term, fully remote freelance roles are ideal for engineers with strong hands-on experience in AWS, Azure, or Google Cloud who want to build scalable, secure, high-performance cloud solut...Show more
Data Engineering Manager – Web Crawling & Pipeline Architecture ( 7 to 2 yrs)
AIMLEAP • guwahati, assam, in
Data Engineering Manager – Web Crawling & Pipeline Architecture.Tech / MCA / Computer Science / IT .IT / Data / AI / E-commerce / FinTech / Healthcare .
Experience working with cloud platforms such ...Show more
Last updated: 14 hours ago • Promoted • New!
AI Tools & Automation Specialist
HappyFares • Guwahati, Assam, India
AI Tools & Automation Specialist.We are looking for a highly skilled and proactive.AI Tools & Automation Specialist.This role is ideal for someone with hands-on expertise in the evolving landscape ...Show more
Last updated: 30+ days ago • Promoted
Software Engineer (Full Stack) - 17853
Turing • Guwahati, Assam, India
Role Overview : Turing is seeking experienced Full Stack Software Engineers to help build end-to-end AI-driven applications for US customers — spanning backend services, web frontends, and evaluatio...Show more
Last updated: 30+ days ago • Promoted
Generative AI Engineer
Live Connections • guwahati, assam, in
Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred.
ML / Data Science with a focus on generative AI, LLMs, or co...Show more
Last updated: 17 days ago • Promoted
Senior Python Developer
Huptech HR Solutions • guwahati, assam, in
Job Description : - Senior Python Developer.Job Location - Ahmedabad (Remote).Software Development : Write clean, scalable, and efficient Python code to develop software applications.Backend Developm...Show more
Last updated: 25 days ago • Promoted
Lead Software Engineer
DigiFocal IT Solutions Pvt Ltd • Guwahati, Assam, India
Lead Software Engineer (TypeScript | React | Node.AWS Serverless) We are looking only for Immediate Joiner.Experience : 7+ Years Mode : Full-Time Location : Remote working About the Role We’re l...Show more
Last updated: 16 days ago • Promoted
AI Automation Engineer
HappyFares • Guwahati, Republic Of India, IN
AI Tools & Automation Specialist.We are looking for a highly skilled and proactive.AI Tools & Automation Specialist.This role is ideal for someone with hands-on expertise in the evolving landscape ...Show more
Last updated: 30+ days ago • Promoted
Cloud Engineer - Full Remote (Global Cloud-Native Projects)
SkillsCapital • guwahati, assam, in
Remote
Last updated: 2 hours ago • Promoted • New!
Full Stack Engineer
AideWiser SolTek • guwahati, assam, in
AWS (EC2, Lambda, S3, RDS, DynamoDB, etc.Design, develop, and maintain backend services using.Net Core / MVC and frontend components using React.
Build and scale backend systems on AWS cloud infrastru...Show more
Last updated: 30+ days ago • Promoted
Ai Tools & Automation Specialist
HappyFares • Guwahati, Republic Of India, IN
AI Tools & Automation Specialist.We are looking for a highly skilled and proactive.AI Tools & Automation Specialist.This role is ideal for someone with hands-on expertise in the evolving landscape ...Show more
Last updated: 30+ days ago • Promoted
Ai Web Scraping Engineer
Alternative Path • Guwahati, Republic Of India, IN
Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show more
Last updated: 21 hours ago • Promoted • New!
Senior Python Automation Engineer - Playwright - (Immediate joiners only)
Innovya Technologies • guwahati, assam, in
Innovya Technologies is a dynamic and growing software consulting firm that drives business automation with cutting-edge solutions.
We help businesses quickly realize value from their technology and...Show more
Last updated: 14 hours ago • Promoted • New!
Python Developer - 17852
Turing • guwahati, India
We’re looking for experienced Python developers to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models think, reason, and...Show more
Last updated: 30+ days ago • Promoted
Software Engineer
SnapNfit • guwahati, assam, in
SnapNfit is one of India’s fastest-growing “fitness at your doorstep” platforms - building premium tech for personal training, physiotherapy, yoga, and more.
We’re expanding our tech team and lookin...Show more
Last updated: 14 hours ago • Promoted • New!
AI / ML Engineer
Cozzera • guwahati, assam, in
We are looking for an experienced AI / ML Engineer with a strong background in machine learning and deep learning, especially in time-series, sensor, and behavioral data.
Strong foundation in ML and d...Show more
Last updated: 14 hours ago • Promoted • New!
Junior Software Engineer
Tilda Research • guwahati, assam, in
A passion for building scalable AI agents.Build scalable back-end services using.Optimize graph database queries and models in Neo4j.
Collaborate cross-functionally with Product, Engineering, and Cl...Show more
Last updated: 14 hours ago • Promoted • New!
Senior Software Engineer
Programmers.io • guwahati, assam, in
We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show more
Last updated: 30+ days ago • Promoted
SageMaker Administrator
Digivance Solutions • Guwahati, Assam, India
Senior AI Engineer / SageMaker Administrator Location : Bangalore / Pune / Mysore / Hyderabad Industry : Banking Experience : 8+ years (3+ years relevant in AI Engineering / AWS / SageMaker) Work Mode...Show more
Last updated: 9 hours ago • Promoted • New!