Data Engineer
PY INDSOLludhiana, punjab, in14 hours ago
Job descriptionProgramming : Proficiency in languages like Python. Libraries : Familiarity with web scraping libraries (e.g., BeautifulSoup, Scrapy) and tools (e.g., Selenium). Web technologies : Understanding of HTML, CSS, and JavaScript. Data handling : Experience with data processing and storage technologies (e.g., SQL, MongoDB). Analytical skills : Strong problem-solving and analytical abilities. Attention to detail : Meticulousness for data accuracy. Experience : Minimum of 1-3 years of experience in web scraping, data operations, or a related role. Education : A Bachelor's degree in Computer Science, Data Science, Engineering, Statistics, or a related field is typically required. A Master's degree in a relevant discipline is a plus. Ability to multi task Honesty & transparency Ability to adapt, accommodate & be considerate in a startup environment Strong communication skills and a willingness to connect with people
Gentle Note : Request everybody study the JD thoroughly before showcasing interest.
PY INDSOL ( PY Industrial solutions private limited) is a soon to be platform for buying and selling reliable used machineries. We are a team of 5 for now. Office is located at Old Damu Nagar, near racecourse, Coimbatore, Tamilnadu, India.
Role : Data engineer
We’re looking for an expert who can design and implement solutions to scrape, clean, and process large datasets from online sources like websites & transform raw data into usable format
Core Responsibilities :
- Design and develop : Create and maintain web scraping scripts to extract data from various online sources.
- Data processing : Clean, transform, and organize large datasets into a usable format.
- Troubleshooting : Identify and fix issues with scrapers to ensure accuracy and reliability.
- Optimization : Improve the speed and efficiency of scraping processes.
- Compliance : Ensure all data collection methods comply with website policies and legal guidelines.
- Documentation : Create documentation for scraping processes and tools
Required Skills :
Qualification :
What we’re also looking for :
Create a job alert for this search
Data Engineer • ludhiana, punjab, in
Related jobs
![Lead Data Engineer [T500-21309]](https://cdn-logos.talent.com/v1/logo/image?feedcode=jobrapido-pms&company_name=ANSR)
- Promoted
Data Engineer
Response Informaticsludhiana, punjab, in We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals.
If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 30+ days ago
- Promoted
GCP Data Engineer
Xsell Resourcesludhiana, punjab, in Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days.
GCP Google Cloud Professional Data Engineer Certi...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
Insight Globalludhiana, punjab, in GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
IntraEdgeludhiana, punjab, in Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago
- Promoted
- New!
Lead Data Engineer
Fornaxludhiana, punjab, in If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 14 hours ago
- Promoted
Data Engineer
ACL Digitalludhiana, punjab, in We are Hiring Data Engineer (Remote).Minimum of 5 years of relevant work experience.Experience with large language models (LLMs), transformers, or reinforcement learning.
Proficiency in Python and M...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
Cimpressludhiana, punjab, in Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
Recroludhiana, punjab, in Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
- New!
Lead Data Engineer [T500-21309]
ANSRludhiana, punjab, in ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show moreLast updated: 14 hours ago
- Promoted
- New!
Data Engineer_P_29th Oct 25
TalentOnLeaseludhiana, punjab, in Big Data Orchestration : Airflow, Spark on Kubernetes, Yarn, Oozie.Big Data Processing : Hadoop, Kafka, Spark & Spark Structured Streaming.
Experience on SOLID & DRY principles with Good Software Arch...Show moreLast updated: 14 hours ago
- Promoted
Data Engineer
AAA Globalludhiana, punjab, in Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team.
In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 24 days ago
- Promoted
Data Engineer
Grid Dynamicsludhiana, punjab, in Grid Dynamics (Nasdaq : GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies.
Grid Dynamics provides digital tra...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Dexian Indialudhiana, punjab, in Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
Tata Consultancy Servicesludhiana, punjab, in Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
- Promoted
- New!
Data Engineer
Nile Connect LLPludhiana, punjab, in We’re Hiring : Data Engineer (5–9 Years Experience).Are you a passionate Data Engineer ready to work with cutting-edge technologies and high-performing teams? We’re looking for an energetic, self-mo...Show moreLast updated: 14 hours ago
- Promoted
Data Engineer II
ClearDemandludhiana, punjab, in Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership.
You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
thinkbridgeludhiana, punjab, in We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses.
We differentiate ourselves by...Show moreLast updated: 30+ days ago
- Promoted
- New!
AWS Lead Data engineer
Tata Consultancy Servicesludhiana, punjab, in In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show moreLast updated: 14 hours ago