Python/Javascript Developer – Web Scraping ( 4 To 7 Years)AIMLEAP • Vijayawada, Republic Of India, IN

Python / Javascript Developer – Web Scraping ( 4 To 7 Years)

AIMLEAP • Vijayawada, Republic Of India, IN

13 hours ago

Job description

Python / JavaScript Developer – Web Scraping - 4 to 7 years

Experience : 4 to 7 Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor's degree in Computer Science, Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
Skilled in JavaScript for web scraping and automation tasks.
Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.

Optimize scraping pipelines for scalability, reliability, and performance.

Work with Scrapy and related Python frameworks / libraries for crawler development.

Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.

Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.

Implement AI / ML-based solutions in scraping workflows, such as :

Using LLMs for content parsing / cleaning.

Automating CAPTCHA solving and anti-bot evasion.

Improving data matching, deduplication, and entity recognition.

Collaborate with data engineers and product teams to ensure scraped data quality and usability.

Maintain proper documentation, testing, and CI / CD practices for scraper code.

Qualifications

Bachelor's degree in computer science, IT, or related field.

Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium).

Proficiency in JavaScript for handling browser automation and dynamic sites.

Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).

Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).

Experience working with databases (SQL / NoSQL) for storing and processing scraped data.

Hands-on experience in AI / ML tools (e.G., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing.

Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.

Strong problem-solving skills for dealing with anti-bot measures and rate limits.

Excellent communication and collaboration skills.

Create a job alert for this search

Web Developer • Vijayawada, Republic Of India, IN

Related jobs

Web Crawling Engineer

Forage AI • Vijayawada, IN

The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Forage AI is a pioneering A...Show more

Last updated: 16 days ago • Promoted

Senior Backend Developer (Remote)

Stealth • Vijayawada, IN

Remote

Fintech Unicorn seeking backend engineers who love building systems that millions trust with their money.Your code directly affects millions of users' financial lives - from seamless payments to sm...Show more

Last updated: 30+ days ago • Promoted

Backend Developer

Assima • Vijayawada, IN

Assima is a worldwide leader in training, assistance and software adoption for Fortune 500 companies.Our patented technology is trusted by 15 of the top 20 banks, major international organizations ...Show more

Last updated: 6 days ago • Promoted

Part-Time Senior Python Backend Developer (3+ years)

Palcode.ai • Vijayawada, IN

We are building cutting-edge AI products in the.General Contractors, Estimators, and Project Managers manage bids, RFIs, and scope gaps. AI Agents, voice automation, and vision systems.Joining us me...Show more

Last updated: less than 1 hour ago • Promoted • New!

Web Developer

Smart Moves Consultants • Vijayawada, IN

Design and develop high-performance, responsive web portals using React.Build scalable backend services and APIs with Node. Integrate and optimize Snowflake for secure data storage, querying, and an...Show more

Last updated: 2 days ago • Promoted

Javascript Developer

Talent Corner HR Services Pvt Ltd • Vijayawada, IN

The ideal candidate will be responsible for developing high-quality applications.They will also be responsible for designing and implementing testable and scalable code. Develop quality software and...Show more

Last updated: less than 1 hour ago • Promoted • New!

Full Stack Web Developer

SME Solutions Advisory LLP • Vijayawada, IN

MSMEs, SMEs, and Startups across India, offering end-to-end handholding to help businesses scale confidently.We specialise in Business Consulting, MSME Incubation Support, Fund-Raising Advisory (De...Show more

Last updated: less than 1 hour ago • Promoted • New!

PTC Windchill Developer

Samay Consulting • Vijayawada, IN

Office timings : 2 : 00 PM—11 : 00 PM.On Behalf of our client we are seeking an experienced PTC Windchill Developer to design, implement, and maintain configurations, customizations and enhancements for...Show more

Last updated: 12 days ago • Promoted

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAP • Vijayawada, IN

Python / JavaScript Developer – Web Scraping - 4 to 7 years.Bachelor's degree in Computer Science, Information Technology. Strong expertise in web scraping with hands-on experience in large-scale data...Show more

Last updated: 30+ days ago • Promoted

Senior Web Scraping Engineer

Zomunk • Vijayawada, IN

We're building a product that relies heavily on collecting structured data from a number of known websites.We need someone experienced who can own this part of the system end-to-end; from writing s...Show more

Last updated: 9 days ago • Promoted

Javascript Developer

Meld Techo • Vijayawada, IN

Meld Techo is a leading IT solutions provider specializing in AI-powered software, IoT technologies, and custom software development tailored for diverse industries. Our solutions, including Travel ...Show more

Last updated: less than 1 hour ago • Promoted • New!

Javascript Developer

Intellias • Vijayawada, IN

We are seeking a highly skilled Senior React Native Developer with a solid understanding of React Native, native platform integration, and scalable architecture. The ideal candidate will have hands-...Show more

Last updated: less than 1 hour ago • Promoted • New!

Cloud Native Developer

RED Global • Vijayawada, IN

Urgent Opportunity- Cloud Native Developer- Contract Opportunity- 100% Remote- 12 months + extension- Full-time- India.Our international IT Consulting client is looking for Cloud Native Developer a...Show more

Last updated: 8 days ago • Promoted

Forward Deployed Engineer

Searchability® • Vijayawada, IN

Forward Deployed Engineer - AI💻.Remote-based - relocation to Dubai📍.Searchability MENA is working with an innovative AI startup looking for a. This is a rare chance to get involved with a company ...Show more

Last updated: 10 days ago • Promoted

Python Web Scraping Engineer – Automation (3 to 10 yrs)

AIMLEAP • Vijayawada, IN

Python Web Scraping Engineer – Advanced Automation (WFH).Bachelor’s degree in Computer Science, IT, or related field .IT / Software Services / Data & AI . Strong hands-on experience handling.Seleniu...Show more

Last updated: less than 1 hour ago • Promoted • New!

Frontend Developer

GoQuant • Vijayawada, IN

Front-End Software Engineer (Python / JavaScript).GoQuant Technologies develops innovative solutions that enhance profitability and ease of use for digital asset traders and researchers.Our key produ...Show more

Last updated: 30+ days ago • Promoted

AI Engineer (Backend) - Python

Edstem Technologies • Vijayawada, IN

We are building the next generation of AI-powered applications that deliver actionable financial and marketing insights to our clients. As an AI Engineer focused on backend development, you'll be in...Show more

Last updated: 9 days ago • Promoted

AI Web Scraping Engineer

S2T AI - AI-Powered Investigations • Vijayawada, IN

We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more

Last updated: 30+ days ago • Promoted