Data Engineer
PY INDSOLlucknow, uttar pradesh, in10 hours ago
Job descriptionProgramming : Proficiency in languages like Python. Libraries : Familiarity with web scraping libraries (e.g., BeautifulSoup, Scrapy) and tools (e.g., Selenium). Web technologies : Understanding of HTML, CSS, and JavaScript. Data handling : Experience with data processing and storage technologies (e.g., SQL, MongoDB). Analytical skills : Strong problem-solving and analytical abilities. Attention to detail : Meticulousness for data accuracy. Experience : Minimum of 1-3 years of experience in web scraping, data operations, or a related role. Education : A Bachelor's degree in Computer Science, Data Science, Engineering, Statistics, or a related field is typically required. A Master's degree in a relevant discipline is a plus. Ability to multi task Honesty & transparency Ability to adapt, accommodate & be considerate in a startup environment Strong communication skills and a willingness to connect with people
Gentle Note : Request everybody study the JD thoroughly before showcasing interest.
PY INDSOL ( PY Industrial solutions private limited) is a soon to be platform for buying and selling reliable used machineries. We are a team of 5 for now. Office is located at Old Damu Nagar, near racecourse, Coimbatore, Tamilnadu, India.
Role : Data engineer
We’re looking for an expert who can design and implement solutions to scrape, clean, and process large datasets from online sources like websites & transform raw data into usable format
Core Responsibilities :
- Design and develop : Create and maintain web scraping scripts to extract data from various online sources.
- Data processing : Clean, transform, and organize large datasets into a usable format.
- Troubleshooting : Identify and fix issues with scrapers to ensure accuracy and reliability.
- Optimization : Improve the speed and efficiency of scraping processes.
- Compliance : Ensure all data collection methods comply with website policies and legal guidelines.
- Documentation : Create documentation for scraping processes and tools
Required Skills :
Qualification :
What we’re also looking for :
Create a job alert for this search
Data Engineer • lucknow, uttar pradesh, in
Related jobs
![Lead Data Engineer [T500-21309]](https://cdn-logos.talent.com/v1/logo/image?feedcode=jobrapido-pms&company_name=ANSR)
- Promoted
Data Engineer
RecroLucknow, IN Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
AAA GlobalLucknow, IN Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team.
In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 24 days ago
- Promoted
Data Engineer
Randstad EnterpriseLucknow, IN Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
- Promoted
- New!
Data & Analytics Engineer
APPIT Software IncLucknow, IN Data Engineer : Snowflake -Mandatory – Hands -on Experience.ETL Tool -Informatica [IVS version],BDT.GCP : Big query – Mandatory -handson experience.
Data Modelling & Data Warehouse -Mandatory -Hands...Show moreLast updated: 14 hours ago
- Promoted
Data Engineer
Insight GlobalLucknow, IN GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer – Azure & AWS
Yoda TechLucknow, IN We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms.
The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 11 days ago
- Promoted
Freelance Data Engineer
upGradLucknow, IN We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 22 days ago
- Promoted
Data Engineer II
ClearDemandLucknow, IN Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership.
You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
Canopus Infosystems - A CMMI Level 3 CompanyLucknow, IN Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
- Promoted
AI / ML & Data Engineer
Mindfire SolutionsLucknow, IN We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS.
You will work closely with cross-functional te...Show moreLast updated: 15 days ago
- Promoted
Data Engineer
Grid Dynamicslucknow, uttar pradesh, in Grid Dynamics (Nasdaq : GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies.
Grid Dynamics provides digital tra...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
VeraxionLucknow, IN Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 13 days ago
- Promoted
Snowflake Data Engineer
Newpage SolutionsLucknow, IN Location : Remote | Type : Contract.Newpage Solutions is a global digital health innovation company helping people live longer, healthier lives.
We partner with life sciences organizations—including p...Show moreLast updated: 2 days ago
- Promoted
- New!
Lead Data Engineer [T500-21309]
ANSRlucknow, uttar pradesh, in ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show moreLast updated: 10 hours ago
- Promoted
Data Engineer
ACL Digitallucknow, uttar pradesh, in GCP – Firestore, Google Cloud Storage, Cloud Build,BigQuery.Nutter Framework – Experience in writing unit test in Nutter Framework.Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
IntraEdgeLucknow, IN We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
- Promoted
- New!
Data Engineer
Nile Connect LLPlucknow, uttar pradesh, in We’re Hiring : Data Engineer (5–9 Years Experience).Are you a passionate Data Engineer ready to work with cutting-edge technologies and high-performing teams? We’re looking for an energetic, self-mo...Show moreLast updated: 10 hours ago
- Promoted
Data Engineer
DigitalzoneLucknow, IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 2 days ago