Big Data Engineer - Hadoop / Hive

HARP Technologies and ServicesKerala

6 days ago

Job description

Description :

Skill : Bigdata + Pyspark
Location : Hyderabad only
Experience : 5-9 Years
Notice Period : Immediate to 30 Days
Interview Mode : L1 Virtual / L2 F2F (Mandatory)
Work Mode : Hybrid
Skills required : Bigdata (Hadoop Hive, Impala, Spark) , pyspark, Python, Oracle, Exadata (RDBMS), Autosys, Bitbucket

Job Summary :

We are seeking a Specialist with 5 to 8 years of experience in the Big Data Hadoop Ecosystem to design and implement scalable data solutions.

Detailed Job Description :

Work extensively with the Big Data Hadoop Ecosystem to process and analyze large datasets.

Utilize Hadoop, Spark, and SparkSQL technologies to build efficient and high-performance data pipelines.

Leverage Python for data manipulation, automation, and integration tasks.

Collaborate with cross-functional teams to gather data requirements and deliver optimized solutions.

Participate in the design, development, and deployment of Big Data applications and frameworks.

Ensure data quality, integrity, and security across big data environments.

Stay current with the latest trends and advancements in Hadoop and Spark technologies.

Optimize system performance and troubleshoot issues related to big data infrastructure.

Roles and Responsibilities :

Design and develop scalable Big Data solutions using the Hadoop and Spark ecosystems.

Implement and optimize SparkSQL queries for performance and efficient resource utilization.

Develop Python scripts for data ingestion, transformation, and workflow automation.

Monitor and maintain Hadoop clusters to ensure high availability and reliability.

Collaborate with data engineers, analysts, and stakeholders to deliver actionable insights.

Conduct code reviews and provide technical guidance to junior team members.

Participate in capacity planning, system tuning, and performance benchmarking.

Document technical specifications, processes, and best practices for big data projects.

(ref : hirist.tech)

Create a job alert for this search

Big Data Engineer • Kerala

Related jobs

Promoted

Data Engineer (Snowflake)

Netstratum TechnologiesErnakulam, Kerala, India

Netstratum is a global product development company specializing in custom software and enterprise IT services.With teams across ten global locations, we combine local insight with global expertise ...Show moreLast updated: 7 days ago

Promoted

Data Engineer

IntraEdgeKottayam, IN

We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

SAIVA AIKottayam, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Big Data Developer(Hive, Pyspark)

Tata Consultancy Serviceskottayam, kerala, in

Big Data Developer(Hive, Pyspark).Years of Experience : 4 to 10 yrs.Location : Bengaluru,Chennai,Hyderabad.Date of Interview : 6th Nov, 2025. Mode of Interview : Virtual Drive( Cisco or WebEx).Hands-on ...Show moreLast updated: 20 days ago

Promoted

Snowflake Data Engineer

Newpage SolutionsKottayam, IN

Location : Remote | Type : Contract.Newpage Solutions is a global digital health innovation company helping people live longer, healthier lives. We partner with life sciences organizations—including p...Show moreLast updated: 7 days ago

Promoted

Senior Data Engineer (AWS / Databricks)

Accoladeernakulam, kerala, in

The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago

Promoted

Big Data Developer(Hadoop)

Tata Consultancy Serviceskottayam, kerala, in

TCS is conducting weekday Virtual Drive for Big Data Developer.Date of Interview : 13th Nov, 2025.Mode of Interview : Virtual Mode( Teams, Cisco, Webex). Software developer with hands-on experience on...Show moreLast updated: 1 day ago

Promoted

Data Engineer

RecroKottayam, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago

Promoted

Freelance Data Engineer

upGradKottayam, IN

We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 26 days ago

Promoted

Data Engineer

DraconXKottayam, IN

DraconX specializes in creating intelligent, scalable digital solutions that drive growth and innovation for startups and enterprises. As pioneers in AI business automation and SaaS platforms, we ex...Show moreLast updated: 2 days ago

Promoted

Big Data Developer

USTkottayam, kerala, in

The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and o...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

DigitalzoneKottayam, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 7 days ago

Promoted

Data Engineer

Response Informaticskochi, kerala, in

AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

American InferenceKerala, India, India

We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines : . AI Strategy, Automation, and Digital Transformation for enterprises.Buildin...Show moreLast updated: 4 days ago

Promoted

Data Engineer

Insight GlobalKottayam, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago

Promoted

Data & Analytics Engineer

APPIT Software IncKottayam, IN

Data Engineer : Snowflake -Mandatory – Hands -on Experience.ETL Tool -Informatica [IVS version],BDT.GCP : Big query – Mandatory -handson experience. Data Modelling & Data Warehouse -Mandatory -Hands...Show moreLast updated: 4 days ago

Promoted

Senior Data Platform Engineer

Black Dog LabsKottayam, IN

Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Mastekernakulam, kerala, in

We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago