No longer accepting applications

Data Engineer

PY INDSOLnavi mumbai, maharashtra, in

1 day ago

Job description

Gentle Note : Request everybody study the JD thoroughly before showcasing interest.

PY INDSOL ( PY Industrial solutions private limited) is a soon to be platform for buying and selling reliable used machineries. We are a team of 5 for now. Office is located at Old Damu Nagar, near racecourse, Coimbatore, Tamilnadu, India.

Role : Data engineer

We’re looking for an expert who can design and implement solutions to scrape, clean, and process large datasets from online sources like websites & transform raw data into usable format

Core Responsibilities :

Design and develop : Create and maintain web scraping scripts to extract data from various online sources.
Data processing : Clean, transform, and organize large datasets into a usable format.
Troubleshooting : Identify and fix issues with scrapers to ensure accuracy and reliability.
Optimization : Improve the speed and efficiency of scraping processes.
Compliance : Ensure all data collection methods comply with website policies and legal guidelines.
Documentation : Create documentation for scraping processes and tools

Required Skills :

Programming : Proficiency in languages like Python.

Libraries : Familiarity with web scraping libraries (e.g., BeautifulSoup, Scrapy) and tools (e.g., Selenium).

Web technologies : Understanding of HTML, CSS, and JavaScript.

Data handling : Experience with data processing and storage technologies (e.g., SQL, MongoDB).

Analytical skills : Strong problem-solving and analytical abilities.

Attention to detail : Meticulousness for data accuracy.

Qualification :

Experience : Minimum of 1-3 years of experience in web scraping, data operations, or a related role.

Education : A Bachelor's degree in Computer Science, Data Science, Engineering, Statistics, or a related field is typically required. A Master's degree in a relevant discipline is a plus.

What we’re also looking for :

Ability to multi task

Honesty & transparency

Ability to adapt, accommodate & be considerate in a startup environment

Strong communication skills and a willingness to connect with people

Create a job alert for this search

Data Engineer • navi mumbai, maharashtra, in

Related jobs

Promoted

Data Engineer II

ClearDemandKalyan-Dombivli, IN

Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 3 days ago

Promoted

Data Engineer

Straivemumbai, maharashtra, in

Data Engineer will be responsible for designing, developing, and maintaining data pipelines and architectures that support the organization's analytics and reporting needs.The ideal candidate will ...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

StraiveMumbai, Mumbai (district)

Analyse relevant internally and externally sourced data (raw data) to generate BI and Advanced.Analytics datasets based on your stakeholders’ requirements. Design data pipelines to curate sourced da...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

Fluent HealthMumbai, Mumbai (district)

Fluent Health is a dynamic healthcare startup revolutionizing how you manage your healthcare and that of your family.The company will provide customers with high-quality, personalized options, cred...Show moreLast updated: 1 day ago

Promoted

Data Engineer

Canopus Infosystems - A CMMI Level 3 CompanyMumbai, IN

Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago

Promoted

Alteryx Data Engineer

Collinsonmumbai, maharashtra, in

Collinson, Working within the Transformation Team, you will be responsible for delivering key elements of our transformation programme. You will create new, and develop existing, Alteryx workflows t...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Envuthane, maharashtra, in

At Envu, we partner with our customers to design world-class, forward-thinking innovations that protect and enhance the health of environments around the world. We offer dedicated services in : Profe...Show moreLast updated: 30+ days ago

Promoted

Data Engineer- Dataverse

CapcoMumbai, Mumbai (district)

We are seeking a highly skilled and experienced.The ideal candidate will combine strong hands-on data engineering expertise with the ability to coordinate and provide leadership for Capco’s.This ro...Show moreLast updated: 1 day ago

Promoted

Data Engineer

AAA Globalmumbai city, maharashtra, in

Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 24 days ago

Promoted

Data Engineer

Dexian Indiadombivli, maharashtra, in

Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 3 days ago

Promoted

Data Engineer

Simple Logic IT Private LimitedMumbai, Maharashtra, India

Hiring for Data Engineer role with Simple Logic IT Pvt Ltd at Navi Mumbai.Note : Hadoop exprience is mandatory.We are seeking a Data Engineer to design, implement, and optimize data pipelines and s...Show moreLast updated: 2 days ago

Data Engineer

CollinsonMumbai, Maharashtra, IN

Quick Apply

We use our expertise and products to craft customer experiences.Our range of services helps global brand acquire, engage and retain choice-rich customers. Collinson International Limited.Registered ...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Insight GlobalKalyan-Dombivli, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

RecroMumbai, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

thinkbridgedombivli, maharashtra, in

We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

FornaxMumbai, Maharashtra, India

If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Response InformaticsMumbai, Maharashtra, India

Cloud & Infrastructure • AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows. Snowflake : Moderate understanding of Snowflake architecture.CI...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

DigitalzoneKalyan-Dombivli, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 3 days ago