Talent.com
This job offer is not available in your country.
Python / JavaScript Developer – Web Scraping & AI / ML (3 to 6 years)

Python / JavaScript Developer – Web Scraping & AI / ML (3 to 6 years)

AIMLEAPLucknow, IN
6 days ago
Job description

Python / JavaScript Developer – Web Scraping & AI / ML (3 to 6 years)

Experience : 3+ Years

Location : Remote

Mode of Engagement : Full-time

No of Positions : 3

Educational Qualifications : Bachelor's degree in Computer Science, Information Technology

Industry : IT / Software Development

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
  • Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
  • Skilled in JavaScript for web scraping and automation tasks.
  • Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
  • Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
  • Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

  • Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.
  • Optimize scraping pipelines for scalability, reliability, and performance.
  • Work with Scrapy and related Python frameworks / libraries for crawler development.
  • Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.
  • Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.
  • Implement AI / ML-based solutions in scraping workflows, such as :
  • Using LLMs for content parsing / cleaning.
  • Automating CAPTCHA solving and anti-bot evasion.
  • Improving data matching, deduplication, and entity recognition.
  • Collaborate with data engineers and product teams to ensure scraped data quality and usability.
  • Maintain proper documentation, testing, and CI / CD practices for scraper code.

    • Qualifications

  • Bachelor's degree in computer science, IT, or related field.
  • Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium).
  • Proficiency in JavaScript for handling browser automation and dynamic sites.
  • Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).
  • Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).
  • Experience working with databases (SQL / NoSQL) for storing and processing scraped data.
  • Hands-on experience in AI / ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing.
  • Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.
  • Strong problem-solving skills for dealing with anti-bot measures and rate limits.
  • Excellent communication and collaboration skills.
    • Create a job alert for this search

    Web Developer • Lucknow, IN

    Related jobs
    • Promoted
    Backend Developer / Data Scraping / Kubernetes

    Backend Developer / Data Scraping / Kubernetes

    Daply | Scaling Digital PublishingLucknow, IN
    IN ORDER TO BE CONSIDERED FOR THIS ROLE, YOU MUST SUBMIT AN APPLICATION HERE : .Web Scraping / Captcha Control.Show moreLast updated: 6 days ago
    • Promoted
    AI Backend Developer – Python

    AI Backend Developer – Python

    Jumbo Consultinglucknow, uttar pradesh, in
    Build and optimize scalable backend systems for AI-driven applications.Design, develop, and maintain APIs & data pipelines in Python. Work with AI / ML teams to deploy and integrate models into produc...Show moreLast updated: 6 days ago
    • Promoted
    UsefulBI Corporation - Full Stack Developer - Python / AngularJS

    UsefulBI Corporation - Full Stack Developer - Python / AngularJS

    USEFULBI CORPORATIONLucknow
    Job Summary : We are seeking a skilled and proactive Full Stack Developer with 6+ years of experience in both backend and frontend development. The ideal candidate will have str...Show moreLast updated: 30+ days ago
    • Promoted
    Next.js Web developer

    Next.js Web developer

    Sweech Ltd.Lucknow, IN
    We are SW company making system software and application for B2B service.We are working with more than 50+ developer in our company. South Korea Seoul / Daegu(Remote).We give about 80,000INR Normally ...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer - Web Scrapping & Enrichment

    Data Engineer - Web Scrapping & Enrichment

    Gala IntelligenceLucknow, IN
    We're looking for an entrepreneurial, passionate, and driven.Navneet Tech Venture situated in.As we're building our technology platform from scratch, you'll have the unique opportunity to shape our...Show moreLast updated: 30+ days ago
    • Promoted
    Backend Python / AI Engineer

    Backend Python / AI Engineer

    JuiceLabs AILucknow, IN
    Where creative engineering meets applied AI.At JuiceLabs, we’re building vertical AI-native tools that unlock fresh insights and creative superpowers for our clients in advertising, ecommerce, and ...Show moreLast updated: 6 days ago
    • Promoted
    Sr. Fullstack engineer

    Sr. Fullstack engineer

    Relevance LabLucknow, IN
    Design, develop, and maintain our AI Agents platform using Python, FastAPI, React, and TypeScript.Collaborate with cross-functional teams, including product managers, designers, and backend enginee...Show moreLast updated: 30+ days ago
    • Promoted
    AI Website Developer

    AI Website Developer

    PravartanLucknow, Uttar Pradesh, India
    AI Website Developer Remote | Flexible Hours | 0–3Yrs Experience We’re building next-gen AI-powered websites — and we want passionate, creative builders to join our mission.Q6iPQK ‍ Role : AI Websi...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    GumoLucknow, IN
    Design, build, and maintain our AI-driven knowledge graph creation pipeline.Integrate third-party APIs for web scraping (e. Tavily), and multimedia processing.Develop and refine sophisticated prompt...Show moreLast updated: 3 days ago
    • Promoted
    Senior Web Scraping Engineer

    Senior Web Scraping Engineer

    S2T AI - AI-Powered InvestigationsLucknow, IN
    We are on the lookout for a highly competent, self-motivated.Gather and process raw data at scale (including writing scripts, web scraping, calling APIs). Able to work independently to complete assi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Developer

    Senior Developer

    Tata Consultancy Serviceslucknow, uttar pradesh, in
    Thank you for expressing your interest in exploring a career possibility with the TCS Family.Jenkins, Gitlab, Github Actions. AWS, Azure or GCP) and services like Sagemaker, AzureML, Vertex AI.Nice ...Show moreLast updated: 15 days ago
    • Promoted
    Python Developer

    Python Developer

    ConfidentialLucknow, India
    As a Senior Python Developer, you will play a pivotal role in designing, developing, and deploying scalable backend solutions, leveraging cloud technologies and modern frameworks.This position is i...Show moreLast updated: 8 days ago
    • Promoted
    AI developer / Support

    AI developer / Support

    Dexian IndiaLucknow, IN
    Understanding of the Basics of Machine Learning.Knowledge of Natural Language Processing (NLP) and NLP Algorithms.Familiarity with Vector Databases. Experience with Azure Cloud and Deployments.Profi...Show moreLast updated: 30+ days ago
    • Promoted
    Calypso Developer

    Calypso Developer

    APPIT Software IncLucknow, IN
    We are looking for Calypso Developer.Total Experience in Years : 5 - 10 years.Top 3 skills which is mandatory.Demonstrable experience (at least 5 years) with Java development, particularly along wi...Show moreLast updated: 5 days ago
    • Promoted
    Sr. Python Backend developer

    Sr. Python Backend developer

    inTune Systems Inclucknow, uttar pradesh, in
    We need 1 Backend engineer with the following skills -.Good programming knowledge in Python.Experience with Cloud platforms - GCP / AWS. Airflow, Netflix Conductor etc.Worked on Apache Spark / beam, Kafka.Show moreLast updated: 5 days ago
    • Promoted
    Azure AI Foundry Developer

    Azure AI Foundry Developer

    UndockedLucknow, IN
    At Undocked, we help companies excel in e-commerce by delivering bespoke optimizations and cutting-edge analytics.Our experiences in retail and supply chain product strategy, technology, and operat...Show moreLast updated: 6 days ago
    • Promoted
    Back End Developer ( GO or Python)

    Back End Developer ( GO or Python)

    Tilda Researchlucknow, uttar pradesh, in
    REMOTE OPPORTUNITY - Join a Series A Rocketship headed to Series B Funding.We require each candidate to complete coding exercises in either " GO" or " Python. Build scalable back-end services using....Show moreLast updated: 30+ days ago
    • Promoted
    Gen AI Engineer

    Gen AI Engineer

    SkillveraLucknow, IN
    Deep expertise in LangChain, LangGraph, Langflow.Able to write UI in AngularJS / React and UI / UX practices.Hands-on experience with LLM interactions, prompt tuning, OpenAI / AWS Bedrock.C# or Java for ...Show moreLast updated: 3 days ago