Python Web Scraping Engineer – Automation (3 to 10 yrs)AIMLEAP • kolkata, west bengal, in
Python Web Scraping Engineer – Automation (3 to 10 yrs)
AIMLEAP • kolkata, west bengal, in
14 hours ago
Job descriptionDevelop and maintain high-scale automated scraping workflows for dynamic and protected websites. Implement browser automation solutions with Playwright / Selenium / Puppeteer for complex user flows and asynchronous rendering. Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms. Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling. Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets. 3–10 years of experience in Python-based web scraping and automation . Strong experience in Selenium, Playwright, Puppeteer , and browser automation. Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy . Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies. Understanding of SQL / NoSQL databases for structured data storage. Experience working with AWS / GCP / Azure is a plus. Strong debugging, analytical, and problem-solving skills.
Python Web Scraping Engineer – Advanced Automation (WFH)
Experience : 3–10 Years
Location : Remote (Work from Home)
Mode of Engagement : Full-time
No of Positions : 8
Educational Qualification : Bachelor’s degree in Computer Science, IT, or related field
Industry : IT / Software Services / Data & AI
Notice Period : Immediate Joiners Preferred
What We Are Looking For
- Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
- Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication / anti-bot systems.
- Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
- Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
- Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.
Responsibilities
Qualifications
Create a job alert for this search
Automation Engineer • kolkata, west bengal, in
Related jobs
Lead Software Engineer
DigiFocal IT Solutions Pvt Ltd • kolkata, west bengal, in
Lead Software Engineer (TypeScript | React | Node.We are looking only for Immediate Joiner.Design, develop, and deploy scalable web applications using TypeScript, React, and Node.Collaborate with p...Show more
Last updated: 15 days ago • Promoted
Web Developer(Node. Js Developer)
SciAstra • kolkata, west bengal, in
You will work on backend logic, APIs, database management, and system architecture.Develop server-side applications using.
Perform database operations using MongoDB / MySQL.Write clean, maintainable, ...Show more
Last updated: 14 hours ago • Promoted • New!
Javascript Developer
Cognizant • kolkata, west bengal, in
Design, develop, and maintain server-side components and APIs using Node.Create and implement RESTful APIs to facilitate communication between the backend and frontend applications.Integrate and in...Show more
Last updated: 16 days ago • Promoted
AI Engineer - GPT / LangChain / RAG / Data Pipelines
Peak Trust Global Real Estate • kolkata, west bengal, in
This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical).
Build automated data collection workflows using tools suc...Show more
Last updated: 14 hours ago • Promoted • New!
Senior Software Engineer
Programmers.io • kolkata, west bengal, in
We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show more
Last updated: 30+ days ago • Promoted
Full Stack Engineer
Programmers.io • kolkata, west bengal, in
Job Title : Senior Full Stack Developer (Laravel + Vue).We are seeking highly skilled Senior Full Stack Developers with 7–10 years of experience in Laravel and modern frontend frameworks (Vue.The ca...Show more
Last updated: 14 days ago • Promoted
Azure Data Engineer
Tata Consultancy Services • kolkata, west bengal, in
Job Title : Azure Data Engineer.Required Skillset : Azure Databricks, Pyspark, SQL, ADF, Data Lake.Azure Databricks, Pyspark, SQL, ADF.
Responsibility of / Expectations from the Role : .Analyzing and tr...Show more
Last updated: 30+ days ago • Promoted
Generative AI Engineer
Live Connections • kolkata, west bengal, in
Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred.
ML / Data Science with a focus on generative AI, LLMs, or co...Show more
Last updated: 16 days ago • Promoted
Javascript Developer
Intellias • kolkata, west bengal, in
We are seeking a highly skilled Senior React Native Developer with a solid understanding of React Native, native platform integration, and scalable architecture.
The ideal candidate will have hands-...Show more
Last updated: 14 hours ago • Promoted • New!
Python Developer
TekXera • kolkata, west bengal, in
Senior Python Engineer – Service Implementation.India | Pakistan | Nigeria | Kenya | Egypt | Ghana | Bangladesh | Turkey | Mexico.
Full-Time Contract (9 Months, Extendable).San Francisco–based AI re...Show more
Last updated: 14 hours ago • Promoted • New!
Full Stack Engineer
oanakademi • kolkata, west bengal, in
We are appointing a fullstack developer with at least 3 years of experience.Full-Stack and Mobile Developer.These roles are highly sought after and often involve building applications that run acro...Show more
Last updated: 14 hours ago • Promoted • New!
Web Developer
AVM Station LLP • Jadavpur, West Bengal, India
Job Title : Custom Website Developer (Real Estate Portal Specialist).You will be responsible for developing, customizing, and maintaining our real estate platform with features like property listing...Show more
Last updated: 5 days ago • Promoted
Lead Full-Stack + AI Engineer (Founding Team)
Grovio AI • kolkata, west bengal, in
We’re building an autonomous, multi-agent AI OS that plans, executes, and optimizes marketing across modern digital ecosystems.
Think : an AI that acts like a virtual CMO — planning, writing, analyz...Show more
Last updated: 6 hours ago • Promoted • New!
Full Stack Engineer
AideWiser SolTek • kolkata, west bengal, in
AWS (EC2, Lambda, S3, RDS, DynamoDB, etc.Design, develop, and maintain backend services using.Net Core / MVC and frontend components using React.
Build and scale backend systems on AWS cloud infrastru...Show more
Last updated: 30+ days ago • Promoted
Full Stack Engineer
Insight Global • kolkata, west bengal, in
Contract with Insight Global Client.React, React Native, TypeScript.React, React Native, and TypeScript.Deploy containerized solutions using.
Ensure high-quality deliverables through.CI / CD pipelines...Show more
Last updated: 30+ days ago • Promoted
Python Developer With Test Driven Development (TDD)
ENCORE IT SOLUTIONS • kolkata, west bengal, in
Job Description – Senior Python Developer – Service Implementation (TDD) (Contract).Short-term Contract (9 months).Flexible (8 hours / day with 4 hours PST overlap).
Candidate should be comfortable wo...Show more
Last updated: 14 hours ago • Promoted • New!
Python for Machine Learning
People Prime Worldwide • kolkata, west bengal, in
Our client is a trusted global innovator of IT and business services.They help clients transform through consulting, industry solutions, business process services, digital & IT modernisation and ma...Show more
Last updated: 2 days ago • Promoted
Senior Software Engineer (NodeJS / Blockchain / Smart Contracts)
ZineIQ • kolkata, west bengal, in
ZineIQ works with the Government and Companies across the globe contributing to their Digital Future.You will be part of the Technical Engineering Team and will be working on managing the operation...Show more
Last updated: 30+ days ago • Promoted