Data EngineerVeca Consulting Pvt Ltd • Gandhinagar, IN
No longer accepting applications
Data Engineer
Veca Consulting Pvt Ltd • Gandhinagar, IN
4 days ago
Job descriptionProficiency in Hadoop ecosystems such as Spark, HDFS, Hive, Iceberg, Spark SQL. Extensive experience with Apache Kafka, Apache Flink, and other relevant streaming technologies. Proven ability to design and implement automated data pipelines and materialized views. Proficiency in Python, Unix or similar languages. Good understanding of SQL oracle, SQL server or similar languages. Ops & CI / CD : Monitoring (Prometheus / Grafana), logging, pipelines (Jenkins / GitHub Actions). Core Engineering : Data structures / algorithms, testing (JUnit / pytest), Git, clean code. 5+ years of directly applicable experience BS in Computer Science, Engineering, or equivalent experience.
Role Name : Data Engineer
Experience : 3+ Years
Location : Bangalore(No relocation)
Notice Period : 20-30 days(who are currently serving)
Mode : Hybrid
Type : Fulltime
Job Description :
As a Data Engineer on our team, you will work on our Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. This is a hands-on role focused on building, optimizing, and maintaining large data pipelines and warehouse infrastructure.
Key Responsibilities
- Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
- Implement data ETL processes for batch and streaming analytics requirements.
- Optimize and troubleshoot distributed systems for ingestion, storage, and processing.
- Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.
- Ensure data security, integrity, and compliance throughout the infrastructure.
- Maintain documentation and contribute to architecture reviews.
- Participate in incident response and operational excellence initiatives for the data warehouse.
- Continuously learn mindset and apply new Hadoop ecosystem tools and data technologies.
Required Skills and Experience
Create a job alert for this search
Data Engineer • Gandhinagar, IN
Related jobs
%20Pvt.%20Ltd.)
GCP Data Engineer
Adastra • Ahmedabad, IN
We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
Last updated: 6 hours ago • Promoted • New!
Freelance Data Engineer
Leading MNC • Gandhinagar, IN
Looking for a Freelance Data Engineer to join a team of rockstar developers.The candidate should have a minimum of 8+ yrs.
If you're looking for freelance / part time opportunity (along with your day...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Recro • Ahmedabad, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Tata Consultancy Services • Gandhinagar, IN
TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Kanerika Inc • Ahmedabad, Gujarat, India
Our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data and AI.
We leverage cutting-edge technologies in...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Veraxion • Gandhinagar, IN
Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show more
Last updated: 24 days ago • Promoted
Data Engineer
IntraEdge • Ahmedabad, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
Google Looker Data Engineer
Insight Global • Gandhinagar, IN
We’re seeking a skilled Data Engineer to support a major reporting migration from Tableau to Google Looker.This role focuses on designing and building scalable data models, data marts, and ETL / ELT ...Show more
Last updated: 5 days ago • Promoted
Data Engineer
Analytix Business Solutions (India) Pvt. Ltd. • Ahmedabad, Gujarat, India
Businesses of all sizes are faced with a rapidly changing competitive environment.Companies that possess both the ability to successfully navigate obstacles and the agility to react to market condi...Show more
Last updated: 6 hours ago • Promoted • New!
Data Engineer
Insight Global • Gandhinagar, IN
GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
ProductSquads • Ahmedabad, Gujarat, India
Company Profile : ProductSquads was founded with a bold mission : to engineer capital efficiency through autonomous AI agents, exceptional engineering, and real-time decision intelligence.We’re build...Show more
Last updated: 4 days ago • Promoted
Data Engineer - Palantir Foundry
NP Group • Gandhinagar, IN
Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
Last updated: 30+ days ago • Promoted
Lead Data Engineer
NexGen Tech Solutions • Ahmedabad, IN
Lead Data Engineer– Wealth Management.Must Have : Wealth Management Domain.We are seeking a highly skilled.Experience in building end-to-end Data Lake and Modern Data Platform programs covering the ...Show more
Last updated: 6 hours ago • Promoted • New!
Data Engineer
Digitalzone • Ahmedabad, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 13 days ago • Promoted
Data Engineer
Randstad Enterprise • Gandhinagar, IN
Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
Last updated: 30+ days ago • Promoted
GCP Data Engineer
PamTen Inc • Gandhinagar, IN
You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
Last updated: 5 days ago • Promoted
Lead Data Engineer
Advantmed • Ahmedabad, Gujarat, India
Lead Data Engineer – Azure Cloud.We are looking for an experienced.The ideal candidate will design, develop, and maintain scalable data pipelines, ensure data quality, and leverage cloud technologi...Show more
Last updated: 6 days ago • Promoted
Data Engineer (GCP)
HISH IT SERVICES • Gandhinagar, IN
We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show more
Last updated: 5 days ago • Promoted