Data Engineer
Impetusdindigul, tamil nadu, in30+ days ago
Job descriptionAWS Cloud Services : Familiarity with S3, Redshift, Lambda, EMR is an advantage. ETL Development : Understanding of ETL processes and data engineering principles. Version Control : Experience using Git for collaborative development. Big Data Tools : Exposure to Hive, PySpark , or similar technologies. Develop and optimize Python scripts for data processing and automation. Write efficient Spark SQL queries for handling large-scale structured data. Assist in ETL pipeline development and maintenance. Support data validation and integrity checks across systems. Collaborate with teams to implement cloud-based solutions (AWS preferred). Optimize performance of data queries and workflows. Troubleshoot and debug issues in existing applications. Document processes and ensure best practices in coding and data handling.
Job Description
Required Skills :
- Python Programming : Strong ability to write clean and efficient code.
- Spark SQL : Good understanding of Spark SQL for distributed data processing.
- Data Processing : Experience with large datasets and structured data manipulation.
- SQL Fundamentals : Ability to write queries and optimize database performance.
- Problem-Solving : Analytical mindset to debug and optimize workflows.
Preferred Skills :
Roles & Responsibilities
Create a job alert for this search
Data Engineer • dindigul, tamil nadu, in
Related jobs
- Promoted
Data Engineer
TalogyDindigul, IN This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Randstad EnterpriseMadurai, IN Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
GEMRAJ TECHNOLOGIES LIMITEDMadurai, IN We are currently seeking a Data Engineer to join our technology team.In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure.The ideal candidate i...Show moreLast updated: 2 days ago
- Promoted
Lead Data Engineer
Searce IncMadurai, IN Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 20 days ago
- Promoted
Data Engineer
IntraEdgeDindigul, IN The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
- Promoted
GCP Data Engineer
EXLDindigul, IN Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 10 days ago
- Promoted
Data Engineer
thinkbridgemadurai, tamil nadu, in We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses.
We differentiate ourselves by...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
V2Softdindigul, tamil nadu, in Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala.
Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 10 days ago
- Promoted
Data Engineer
Manuh TechnologiesMadurai, IN S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
- Promoted
AI / ML & Data Engineer
Mindfire SolutionsMadurai, IN We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS.
You will work closely with cross-functional te...Show moreLast updated: 1 day ago
- Promoted
Freelance Data Engineer
upGradDindigul, IN We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 8 days ago
- Promoted
Data Engineer
Kline + CompanyMadurai, IN Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 25 days ago
- Promoted
Data Engineer
AAA GlobalMadurai, IN Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team.
In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 10 days ago
- Promoted
Data Engineer
Jaipur RugsMadurai, IN Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets.
It is a family-run business that offers an exclusive range of hand-kn...Show moreLast updated: 6 days ago
- Promoted
Data Engineer - Scala
Idyllic ServicesDindigul, IN Code Optimization , Shell Scripting, Data Engineering & Scala.Big Data tools like Spark, Hadoop & Hive.The Senior Data Engineer will be responsible for designing, developing, and maintaining scalab...Show moreLast updated: 8 days ago
- Promoted
Data Engineer
VAANTECHmadurai, tamil nadu, in Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning.
Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
ITQube LTDdindigul, tamil nadu, in Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 20 days ago
- Promoted
Data Engineer
RevXMadurai, IN RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago