No longer accepting applications
Data Engineer
Veca Consulting Pvt LtdErode, IN8 days ago
Job descriptionProficiency in Hadoop ecosystems such as Spark, HDFS, Hive, Iceberg, Spark SQL. Extensive experience with Apache Kafka, Apache Flink, and other relevant streaming technologies. Proven ability to design and implement automated data pipelines and materialized views. Proficiency in Python, Unix or similar languages. Good understanding of SQL oracle, SQL server or similar languages. Ops & CI / CD : Monitoring (Prometheus / Grafana), logging, pipelines (Jenkins / GitHub Actions). Core Engineering : Data structures / algorithms, testing (JUnit / pytest), Git, clean code. 5+ years of directly applicable experience BS in Computer Science, Engineering, or equivalent experience.
Role Name : Data Engineer
Experience : 3+ Years
Location : Bangalore(No relocation)
Notice Period : 20-30 days(who are currently serving)
Mode : Hybrid
Type : Fulltime
Job Description :
As a Data Engineer on our team, you will work on our Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. This is a hands-on role focused on building, optimizing, and maintaining large data pipelines and warehouse infrastructure.
Key Responsibilities
- Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
- Implement data ETL processes for batch and streaming analytics requirements.
- Optimize and troubleshoot distributed systems for ingestion, storage, and processing.
- Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.
- Ensure data security, integrity, and compliance throughout the infrastructure.
- Maintain documentation and contribute to architecture reviews.
- Participate in incident response and operational excellence initiatives for the data warehouse.
- Continuously learn mindset and apply new Hadoop ecosystem tools and data technologies.
Required Skills and Experience
Create a job alert for this search
Data Engineer • Erode, IN
Related jobs
- Promoted
Data Engineer (GCP)
HISH IT SERVICESSalem,Tamil Nadu, IN We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show moreLast updated: 9 days ago
- Promoted
Data Engineer - Palantir Foundry
NP GroupSalem,Tamil Nadu, IN Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Tata Consultancy ServicesSalem,Tamil Nadu, IN TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
LanceSoft, Inc.Erode, IN This team is looking to hire a motivated Sr.Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data platform to solve vario...Show moreLast updated: 2 days ago
- Promoted
Databricks Data Engineer Lead – Sustainability Project
Blue Cloud Softech Solutions LimitedSalem,Tamil Nadu, IN BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 3 days ago
- Promoted
Data Engineer
IntraEdgeTiruppur, IN We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
RecroTiruppur, IN Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
BayOne SolutionsSalem,Tamil Nadu, IN We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
MyData Insights Pvt LtdTiruppur, IN The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 1 day ago
- Promoted
Senior Data Engineer
MindlanceSalem,Tamil Nadu, IN We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 1 day ago
- Promoted
GCP Data Engineer
PamTen IncErode, IN You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show moreLast updated: 10 days ago
- Promoted
GCP Data Engineer
Xsell ResourcesErode, IN Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days.
GCP Google Cloud Professional Data Engineer Certi...Show moreLast updated: 16 days ago
- Promoted
Data Engineer
DigitalzoneErode, IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 17 days ago
- Promoted
Data Engineer
Insight GlobalTiruppur, IN GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
- New!
Data Engineer – CDP
Integers.AiErode, IN Job Description : Data Engineer – CDP.Data Engineer with strong CDP expertise.The ideal candidate will have hands-on experience working with Customer Data Platforms—specifically Real-Time CDP and Sa...Show moreLast updated: 2 hours ago
- Promoted
Data Engineer
AceolutionTiruppur, IN Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Randstad EnterpriseTiruppur, IN Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
- Promoted
GCP Data Engineer
AdastraErode, IN We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show moreLast updated: 4 days ago