Senior Associate- Web Scrapping

Job Responsibilities :

Develop and maintain web scraping scripts using Javascript, Python and Selenium to extract data from websites and APIs

Understanding requirement of customer needs, identify source and scrape / collect data.

Writing efficient, reusable, testable, and testing scalable code.

Build code that is easily readable, properly documented, and follows key coding standards.

Use Brightdata, Beautiful Soup, Selenium and other scraping tools to clean and process data for analysis

Research and learn new technologies to design code reviews and application enhancements / upgrades

Performance tuning and automation of application.

Maintain communication with corporate clients, Coordination with team and management.

Coordinating with development teams to determine application requirements.

Prioritized daily workflows, including all projects and task

Experience :

3 years in web scraping to develop and maintain web scraping solutions

Proficiency with Javascript, Python, Brightdata, Selenium and Beautiful Soup

Depth knowledge of Operators, Datatypes, Casting, Methods, Conditions, Loops, Functions, Arrays, OOPS concept, iterators, Modules and Python

Strong understanding of web scraping techniques and best practices

HTML, CSS, XPATH, Regex and HTML DOM

Knowledge of Libraries like Selenium, Requests, Scrappy, BeautifulSoup, NumPy, Pandas.

Good hands-on experience in Python languages and debugging with GDB

File Format : JSON, XML, Excel, CSV

Development Tools : Microsoft Visual Studio, Visual Code

Experience with data storage and retrieval in AWS S3.

Knowledge of serverless architecture using AWS Lambda.