Talent.com
Senior Software Engineer( Java, Hadoop, ETL, Data Pipelines)
Senior Software Engineer( Java, Hadoop, ETL, Data Pipelines)Prescience Decision Solutions (A Movate Company) • Bengaluru / Bangalore, India
No longer accepting applications
Senior Software Engineer( Java, Hadoop, ETL, Data Pipelines)

Senior Software Engineer( Java, Hadoop, ETL, Data Pipelines)

Prescience Decision Solutions (A Movate Company) • Bengaluru / Bangalore, India
30+ days ago
Job description

We are looking for a Senior Software Engineer with 4+ years who thrives at the intersection of high-performance Java development and large-scale data orchestration. In this role, you will build resilient, cloud-native systems that power our real-time analytics, work on Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. This is a hands-on role focused on building, optimizing, and maintaining large data pipelines and warehouse infrastructure.

Key Responsibilities:

  • Build and support java based applications in the data domain with 4 - 8 years of experience.
  • Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
  • Implement data ETL processes for batch and streaming analytics requirements.
  • Optimize and troubleshoot distributed systems for ingestion, storage, and processing.
  • Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.
  • Ensure data security, integrity, and compliance throughout the infrastructure.
  • Maintain documentation and contribute to architecture reviews.
  • Participate in incident response and operational excellence initiatives for the data warehouse.
  • Continuously learn and apply new Hadoop ecosystem tools and data technologies.

Required Skills and Experience:

  • Java + Spring Boot: Build and maintain microservices.
  • Apache Flink: Develop and optimize streaming/batch pipelines.
  • Cloud Native: Docker, Kubernetes (deploy, network, scale, troubleshoot).
  • Messaging & Storage: Kafka; NoSQL KV stores (Redis, Memcached, MongoDB etc.).
  • Python: Scripting, automation, data utilities.
  • Ops & CI/CD: Monitoring (Prometheus/Grafana), logging, pipelines (Jenkins/GitHub Actions).
  • Core Engineering: Data structures/algorithms, testing (JUnit/pytest), Git, clean code.

About Prescience Decision Solutions PVT Ltd:

A Bangalore-based company specializing in Data Science, Advanced Analytics, AI and Data Engineering, founded by a team of highly experienced industry professionals from IIT & IIMs.

Prescience Decision Solutions is a cutting-edge analytics and AI consulting firm, delivering high-impact data-driven solutions across a wide range of industries. We partner with top-tier global MNCs and contribute to critical projects with industry leaders like Movate, while also developing and deploying innovative solutions for our own flagship initiatives. Our expertise spans advanced analytics, AI/ML modeling, decision intelligence, and digital transformation—empowering businesses to unlock actionable insights and drive strategic outcomes. At Prescience, we don't just analyze data—we transform it into decisive competitive advantage.

Prescience Decision Solutions, honored as a Top-Three Startup in People Excellence by xto10x, boasts a 97-percentile employee NPS, 100% mutual respect among employees, and a 98% employee pride rate.

For more details visit: www.prescienceds.com


Skills Required
Java, Pytest, Apache Flink, Data Structures, Prometheus, Kafka, Spring Boot, Grafana, Redis, Nosql, Memcached, Jenkins, Algorithms, Junit, Docker, Mongodb, Python, Kubernetes
Create a job alert for this search

Senior Software Engineer( Java, Hadoop, ETL, Data Pipelines) • Bengaluru / Bangalore, India

Similar jobs
Senior data engineer

Senior data engineer

Tredence Inc. • Bengaluru, Karnataka, India
Role - GCP Data Engineer with Py Spark & Python expertise.Preferred - Data Engineering Background.Required Skills - GCP DE Experience, Big Query, Py Spark, Python.Have Implemented and Architected s...Show more
Last updated: 10 days ago • Promoted
Senior Data Engineer

Senior Data Engineer

Kagool • bangalore district, karnataka, in
We are a fast-growing IT consultancy specialising in the transformation of complex Global enterprises.We are looking for passionate and hardworking individuals that to help deliver for our global c...Show more
Last updated: 4 days ago • Promoted
Senior Data Engineer

Senior Data Engineer

R Systems • bangalore district, karnataka, in
We are seeking a highly skilled.Google Cloud Platform (GCP) Data engineer role.SAP data integration expertise.The ideal candidate will combine deep expertise in.ETL/ELT pipelines, SAP data extracti...Show more
Last updated: 28 days ago • Promoted
Databricks-Senior Data Engineer

Databricks-Senior Data Engineer

Tredence Inc. • bangalore, karnataka, in
We are seeking an experienced professional who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the do...Show more
Last updated: 15 days ago • Promoted
Senior Data Engineer

Senior Data Engineer

Bajaj Tech.AI • bangalore, India
Candidates from Top Tier collages.Execute large scale data processing and report generation for in order to drive successful financial reconciliation on monthly basis.Work closely with the Finance ...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer

Senior Data Engineer

Computomic • bangalore, India
We’re Hiring: Senior Data Engineers (Immediate to 30 days).Location: Whitefield, Bangalore.Project Scope: Complex DWH & Migration initiatives across the full data engineering lifecycle.Are you pass...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer

Senior Data Engineer

Solvex Solutions • bangalore district, karnataka, in
AWS PySpark Databricks Technical Lead / Architect.This role requires strong technical expertise and active involvement in design, development, and problem-solving—not people management.Design and d...Show more
Last updated: 13 hours ago • Promoted • New!
Senior Data Engineer

Senior Data Engineer

Sigmoid • bangalore, karnataka, in
Were Hiring!!!!!! Azure Data Engineer_SDE-2.We are a fast-growing analytics and data engineering organization helping global enterprises build modern data platforms on Azure.Our teams work on large...Show more
Last updated: 9 days ago • Promoted
Senior Software Data Engineer

Senior Software Data Engineer

HME • Bengaluru, India
Senior Software Data Engineer Job Description.For over 50 years, HME has created industry-leading products and services, beginning with the first wireless microphone for the professional audio mark...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer

Senior Data Engineer

Tredence Inc. • Bengaluru, Republic Of India, IN
Role - GCP Data Engineer with PySpark & Python expertise.Preferred - Data Engineering Background.Required Skills - GCP DE Experience, Big Query, PySpark, Python.Have Implemented and Architected sol...Show more
Last updated: 10 days ago • Promoted
Senior Data Engineer

Senior Data Engineer

Velodata Global Pvt Ltd • bangalore, karnataka, in
Senior Data Engineer (Kafka & AWS).Bangalore, Hyderabad, Kochi, Trivandrum, Pune.Python, AWS, Apache Kafka, PySpark.We are seeking a highly skilled.Apache Kafka and AWS data services.The ideal cand...Show more
Last updated: 6 days ago • Promoted
Lead/ Senior Data Engineer with Databricks_ Exp: 7+ Years_ Hybrid Model

Lead/ Senior Data Engineer with Databricks_ Exp: 7+ Years_ Hybrid Model

Atyeti Inc • bangalore, karnataka, in
Develop and maintain data pipelines using.SQL and data warehousing concepts.Design and implement ETL/ELT workflows for large-scale data processing.Work with structured and unstructured data from mu...Show more
Last updated: 5 days ago • Promoted
Senior Data Engineer

Senior Data Engineer

Lateetud • bangalore district, karnataka, in
Senior Data Engineer (Azure / Microsoft Technologies).Location: India (Remote, Full-Time).Experience: 7+ Years (Strong Hands-On, Production-Grade).Design, build, and operate modern, cloud-native da...Show more
Last updated: 22 days ago • Promoted
Senior Data Engineer

Senior Data Engineer

Aspire, Jordan • bangalore, karnataka, in
Aspire, you will design, build, and maintain scalable data pipelines to support production data workflows.You will implement end-to-end ETL/ELT pipelines, optimize data processing, and integrate pi...Show more
Last updated: 7 days ago • Promoted
Lead/Senior Data Engineer

Lead/Senior Data Engineer

TEKsystems Global Services in India • bangalore, karnataka, in
Infrastructure as Code (IaC) tools like Terraform or AWS CloudFormation.Looking for Lead Software Engineer with 7+ years of experience in software development, with a strong foundation in distribut...Show more
Last updated: 30+ days ago • Promoted
Senior AWS Data Engineer

Senior AWS Data Engineer

TEKsystems Global Services in India • bangalore, karnataka, in
In-depth knowledge of AWS services related to data engineering: EC2, S3, RDS, DynamoDB, Redshift, Glue, Lambda, Step Functions, Kinesis, Iceberg,EMR, and Athena.Strong understanding of cloud archit...Show more
Last updated: 19 days ago • Promoted
Senior Data Engineer

Senior Data Engineer

TEKsystems Global Services in India • bangalore, karnataka, in
JD: GCP BigQuery, Dataflow, Spark, SQL - 6+ years.GCP Cloud Engineer- Mid Level:.Proficient in BigQuery and GCP Data Services like DataFlow.BQ Optimization – SQL, Normalization, Partitioning, View ...Show more
Last updated: 15 days ago • Promoted
Senior Integration Engineer

Senior Integration Engineer

Simelabs - Digital, AI/ML, Automation, Robotics, Gen AI. • Bengaluru, Karnataka, India
Design, build, and maintain scalable integration services and microservices using Java (primary) and Python (secondary).Develop and manage the full API lifecycle, including REST APIs and event-driv...Show more
Last updated: 30+ days ago • Promoted