Talent.com
This job offer is not available in your country.
Python Developer - Web Crawling / Scraping

Python Developer - Web Crawling / Scraping

BYLD GroupGurugram
30+ days ago
Job description

Designation : Python Developer & Web Crawling

Experience : 3 to 5 Years

Location : Gurgaon, Haryana

Entity : Global Checks Pvt ltd

Role & Responsibilities :

  • Collaborate with cross-functional teams to define, design, and implement new features.
  • Ensure the performance, quality, and responsiveness of web crawling systems.
  • Identify and correct bottlenecks and fix bugs in web crawling processes.
  • Help maintain code quality, organization, and automation.
  • Stay up-to-date with the latest industry trends and technologies.

Skills :

  • 3+ years of experience in Web Scraping or Crawling through Scrapy, Selenium or other frameworks and related libraries (like beautifulsoup, puppeteer).
  • Should be expert on latest version of Python.
  • Should have very good experience on fetching data from multiple online sources, cleanse it and build APIs on top of it.
  • Good understanding of data structure and algorithms, as well as how they affect system performance in real world applications
  • Sound knowledge in bypassing Bot Detection techniques.
  • Web RestFul APIs / Microservices Development Experience.
  • Think deeply about developing large scale scraping tools including data integrity, health and monitoring systems.
  • Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrape, parse and store.
  • Work with SQL and NoSQL databases to store raw data.
  • Develop frameworks for automating and maintaining constant flow of data from multiple sources.
  • Good knowledge of distributed technologies, real-time systems of high throughput, low latency, and highly scalable systems.
  • Work independently with little supervision to research and test innovative solutions.
  • Should have a strong passion for coding.
  • Must take quality, security and performance seriously.
  • Ability to pair with other engineers and cross-team as needed.
  • Excellent communication skills, including the ability to present effectively to both business and technical

    • Why join BYLD : Perks & Benefits :

  • Learn directly from industry experts with 20+ years of experience
  • Opportunity to work in a dynamic and collaborative environment.
  • Professional development and growth opportunities.
  • Gain experience in world class management practices
  • Insurance Benefits (Medical and Accidental) for all employees
  • Multi-level Rewards programs for all employees

    • (ref : hirist.tech)

    Create a job alert for this search

    Web Developer • Gurugram