Data Engineer
PY INDSOLtamil nadu, tamil nadu, in6 hours ago
Job descriptionProgramming : Proficiency in languages like Python. Libraries : Familiarity with web scraping libraries (e.g., BeautifulSoup, Scrapy) and tools (e.g., Selenium). Web technologies : Understanding of HTML, CSS, and JavaScript. Data handling : Experience with data processing and storage technologies (e.g., SQL, MongoDB). Analytical skills : Strong problem-solving and analytical abilities. Attention to detail : Meticulousness for data accuracy. Experience : Minimum of 1-3 years of experience in web scraping, data operations, or a related role. Education : A Bachelor's degree in Computer Science, Data Science, Engineering, Statistics, or a related field is typically required. A Master's degree in a relevant discipline is a plus. Ability to multi task Honesty & transparency Ability to adapt, accommodate & be considerate in a startup environment Strong communication skills and a willingness to connect with people
Gentle Note : Request everybody study the JD thoroughly before showcasing interest.
PY INDSOL ( PY Industrial solutions private limited) is a soon to be platform for buying and selling reliable used machineries. We are a team of 5 for now. Office is located at Old Damu Nagar, near racecourse, Coimbatore, Tamilnadu, India.
Role : Data engineer
We’re looking for an expert who can design and implement solutions to scrape, clean, and process large datasets from online sources like websites & transform raw data into usable format
Core Responsibilities :
- Design and develop : Create and maintain web scraping scripts to extract data from various online sources.
- Data processing : Clean, transform, and organize large datasets into a usable format.
- Troubleshooting : Identify and fix issues with scrapers to ensure accuracy and reliability.
- Optimization : Improve the speed and efficiency of scraping processes.
- Compliance : Ensure all data collection methods comply with website policies and legal guidelines.
- Documentation : Create documentation for scraping processes and tools
Required Skills :
Qualification :
What we’re also looking for :
Create a job alert for this search
Data Engineer • tamil nadu, tamil nadu, in
Related jobs
- Promoted
Data Engineer
Randstad EnterpriseTiruchirappalli, IN Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
EXLtamil nadu, tamil nadu, in Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
JMAN Grouptamil nadu, tamil nadu, in JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Insight GlobalTiruchirappalli, IN GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
VeraxionTiruchirappalli, IN Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 14 days ago
- Promoted
Data Engineer
AAA GlobalTiruchirappalli, IN Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team.
In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 24 days ago
- Promoted
AI / ML & Data Engineer
Mindfire SolutionsTiruchirappalli, IN We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS.
You will work closely with cross-functional te...Show moreLast updated: 16 days ago
- Promoted
Data Engineer – Azure & AWS
Yoda TechTiruchirappalli, IN We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms.
The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 12 days ago
- Promoted
Data Engineer II
ClearDemandTiruchirappalli, IN Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership.
You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 3 days ago
- Promoted
Data Engineer
Dexian Indiatiruchirappalli, tamil nadu, in Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 3 days ago
- Promoted
Data Engineer
RecroTiruchirappalli, IN Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Canopus Infosystems - A CMMI Level 3 CompanyTiruchirappalli, IN Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
IntraEdgeTiruchirappalli, IN Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
thinkbridgetiruchirappalli, tamil nadu, in We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses.
We differentiate ourselves by...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
NAF Technology Indiatamil nadu, tamil nadu, in Do you love a Challenge? Are you Passionate about technology? Are you customer obsessed? Looking to innovate? Join NAF Tech! New American Funding (NAF) is a mortgage lender offering an array of loa...Show moreLast updated: 22 days ago
- Promoted
Snowflake Data Engineer
Newpage SolutionsTiruchirappalli, IN Location : Remote | Type : Contract.Newpage Solutions is a global digital health innovation company helping people live longer, healthier lives.
We partner with life sciences organizations—including p...Show moreLast updated: 3 days ago
- Promoted
Data Engineer
Tata Consultancy Servicestiruchirappalli, tamil nadu, in Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
DigitalzoneTiruchirappalli, IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 3 days ago