Talent.com
This job offer is not available in your country.
Data Engineer - Web Scraping

Data Engineer - Web Scraping

Alternative Pathranchi, jharkhand, in
30+ days ago
Job description

Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to make your voice heard.

Role Summary :

Performing Web Scraping using various scraping techniques and then utilizing Python’s Pandas library for data cleaning and manipulation. Then ingesting the data into a Database / Warehouse, and scheduling the scrapers using Airflow or other tools

Role Overview

The Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation.

In your role, you will :

➢ Collaborate with analysts to understand and anticipate requirements.

➢ Design, implement, and maintain Web scrapers for a wide variety of alternative datasets.

➢ Perform Data Cleaning, Exploration, Transformation etc. of scraped data.

➢ Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows.

➢ Author QC checks to validate data availability and integrity.

➢ Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day-to-day operations.

➢ Design and implement products and tools to enhance the Web scraping Platform.

Qualifications

Must have

➢ Bachelor's / master’s degree in computer science or in any related field

➢ 2-4 years of software development experience

➢ Strong Python and SQL / Database skills

➢ Strong expertise in using the Pandas library (Python) is a must

➢ Experience with web technologies (HTML / JS, APIs, etc.)

➢ Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements.

➢ Excellent verbal and written communication skills

➢ Aptitude for designing infrastructure, data products, and tools for Data Scientists

Preferred

➢ Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, xpath) ➢ Experience containerizing workloads with Docker (Kubernetes a plus)

➢ Experience with build automation (Jenkins, Gitlab CI / CD) ➢ Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc.

Create a job alert for this search

Data Engineer • ranchi, jharkhand, in

Related jobs
  • Promoted
Data Engineer

Data Engineer

Everiseranchi, jharkhand, in
Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 19 days ago
  • Promoted
Lead Data Engineer

Lead Data Engineer

Eucloid Data Solutionsranchi, jharkhand, in
Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 20 days ago
  • Promoted
Data Engineer

Data Engineer

Kumaran Systemsranchi, jharkhand, in
Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 20 days ago
AWS Data Engineer

AWS Data Engineer

Epergne SolutionsGurgaon, Jharkhand, India
Quick Apply
Job Roles & Responsibilities.Design, build, and optimize data pipelines and scalable data assets.Develop and maintain high-performance code using PySpark / Python with best practices.Perform code...Show moreLast updated: 25 days ago
  • Promoted
Data Engineer

Data Engineer

Bahwan CyberTekRanchi, Jharkhand, India
Role Overview We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services.The ideal candidate will...Show moreLast updated: 30+ days ago
  • Promoted
Data Engineer

Data Engineer

RevXranchi, jharkhand, in
RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 20 days ago
  • Promoted
Data Engineer

Data Engineer

VAANTECHranchi, jharkhand, in
Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
  • Promoted
Data Engineer

Data Engineer

Namasys AnalyticsRanchi, Jharkhand, India
We’re Hiring : Data Engineer Work Type : 100% Remote Experience : 6+ Years Notice Period : Immediate joiners preferred; up to 15 days acceptable Summary Seeking a Data Engineer to design, build, an...Show moreLast updated: 8 days ago
  • Promoted
AI Web Scraping Engineer

AI Web Scraping Engineer

S2T AI - AI-Powered Investigationsranchi, jharkhand, in
We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show moreLast updated: 13 days ago
  • Promoted
Senior Web Scraping Engineer

Senior Web Scraping Engineer

S2T AI - AI-Powered Investigationsranchi, jharkhand, in
We are on the lookout for a highly competent, self-motivated.Gather and process raw data at scale (including writing scripts, web scraping, calling APIs). Able to work independently to complete assi...Show moreLast updated: 20 days ago
  • Promoted
Full Stack Engineer

Full Stack Engineer

ITC Infotechranchi, jharkhand, in
Architect and lead the development of a multi-tenant Generative AI platform built on Fast API (Python) and Next.Drive system design, coding standards, and design patterns (e.Singleton, Factory, CQR...Show moreLast updated: 30+ days ago
  • Promoted
Data Engineer

Data Engineer

IntraEdgeRanchi, Jharkhand, India
Job Title : Data Engineer Experience : 5+Years Location : [Remote] Senior Data Engineer The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used b...Show moreLast updated: 30+ days ago
  • Promoted
Sales And Marketing Specialist

Sales And Marketing Specialist

JAI MATA DIJharkhand, India, India
We suggest you enter details here.This is a full-time, on-site role for a Sales and Marketing Specialist in Jamshedpur, Jharkhand, India. The Specialist will be responsible for planning and executin...Show moreLast updated: 11 days ago
  • Promoted
Data Engineer

Data Engineer

INFEC Servicesranchi, jharkhand, in
Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 17 days ago
Azure Data Engineer

Azure Data Engineer

Saaki Argus & Averil ConsultingGurgaon, Jharkhand, India
Quick Apply
We are looking to hire Azure Data Engineers for a client who is a leader in the AI and Analytics solution.You will work on a broad range of cutting-edge data analytics problems.Design and build sca...Show moreLast updated: 30+ days ago
  • Promoted
Senior Data Engineer (AWS / Databricks)

Senior Data Engineer (AWS / Databricks)

Accoladeranchi, jharkhand, in
The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 8 days ago
  • Promoted
Data Engineer

Data Engineer

Vriba Solutionsranchi, jharkhand, in
Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 8 days ago
  • Promoted
Data Engineer

Data Engineer

Canopus Infosystems - A CMMI Level 3 Companyranchi, jharkhand, in
Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago