This job offer is not available in your country.
2567- Data Engineer - Java Spark
EXLindia, India11 hours ago
Job descriptionJob Title : Data Engineer (Java) Location : All EXL Locations Design, develop, and optimize scalable batch data pipelines using Java and Apache Spark to handle large volumes of structured and semi-structured data. Utilize Apache Iceberg to manage data lakehouse environments, supporting advanced features such as schema evolution and time travel for data versioning and auditing. Build and maintain reliable data ingestion and transformation workflows using AWS Glue , EMR , and Lambda services to ensure seamless data flow and integration. Integrate with Snowflake as the cloud data warehouse to enable efficient data storage, querying, and analytics workloads. Collaborate closely with DevOps and infrastructure teams to automate deployment, testing, and monitoring of data workflows using CI / CD tools like Jenkins . Develop and manage CI / CD pipelines for Spark / Java applications, ensuring automated testing and smooth releases in a cloud environment. Monitor and continuously optimize the performance, reliability, and cost-efficiency of data pipelines running on cloud-native platforms. Implement and enforce data security, compliance, and governance policies in line with organizational standards. Troubleshoot and resolve complex issues related to distributed data processing and integration. Work collaboratively within Agile teams to deliver high-quality data engineering solutions aligned with business requirements. Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field. Strong proficiency in Java programming with solid understanding of object-oriented design principles. Proven experience designing and building ETL / ELT pipelines and frameworks. Excellent command of SQL and familiarity with relational database management systems. Hands-on experience with big data technologies such as Apache Spark , Hadoop , and Kafka or equivalent streaming and batch processing frameworks. Knowledge of cloud data platforms, preferably AWS services (Glue, EMR, Lambda) and Snowflake . Experience with data modeling, schema design, and concepts of data warehousing. Understanding of distributed computing, parallel processing, and performance tuning in big data environments. Strong analytical, problem-solving, and debugging skills. Excellent communication and teamwork skills with experience working in Agile environments. Experience with containerization and orchestration technologies such as Docker and Kubernetes . Familiarity with workflow orchestration tools like Apache Airflow . Basic scripting skills in languages like Python or Bash for automation tasks. Exposure to DevOps best practices and building robust CI / CD pipelines. Prior experience managing data security, governance, and compliance in cloud environments.
Salary : Competitive / Paid in Indian Rupee . INR / Annual Recommended Quick Links
- Jobs by Location
- Jobs by Industry
What You Should Know About This Job
Job Summary :
We are seeking a skilled Data Engineer with strong expertise in Java and big data technologies to design, develop, and maintain scalable batch data pipelines. The ideal candidate will have hands-on experience working with modern data lakehouse architectures, cloud-native data platforms, and automation tools to support high-performance analytics and data processing workloads.
Key Responsibilities :
Required Skills and Qualifications :
Preferred Qualifications :
Create a job alert for this search
Data Engineer • india, India
Related jobs
)
- Promoted
- New!
Big Data Lead Engineer — Hadoop, Spark & GCP (BigQuery / DataProc) with Java & Python Expertise
Synechronindia, India Synechron is seeking an experienced Big Data Lead Engineer to drive the design, development, and management of large-scale data solutions.
This full-time leadership role involves guiding a team of d...Show moreLast updated: 11 hours ago
- Promoted
- New!
SQL Python Spark – Data Engineers Developer
Tavantindia, India SQL Python Spark – Data Engineers Developer.Looking for an expert in SQL, Python, Spark Snowflake is good to have.Looking for an expert in SQL, Python, Spark Snowflake is good to have.Excellent com...Show moreLast updated: 12 hours ago
- Promoted
- New!
AWS – Data Engineer
Epergne Solutionsnagpur, India Pune / Hyderabad / Chennai / Mysuru / Bhubaneswar / Mangalore / Trivandrum / Chandigarh / Jaipur / Nagpur / Indore / Gurgaon.
Job Roles & Responsibilities : -.Leverage AWS services (S3, EC2, Lambda, Redshift, CloudFormati...Show moreLast updated: 12 hours ago
- Promoted
- New!
Scala Spark Developer
Tavantindia, India Job Code : TI-82594 | Tavant Technologies India Private Limited .Design, develop, test and deploy technical solutions.Implement automated acceptance tests.
Good knowledge in OS concepts and hands-on ...Show moreLast updated: 12 hours ago
- Promoted
- New!
Data Engineer (Java+Spark)
Persistent Systemsindia, India Competitive / Paid in Indian Rupee.What You Should Know About This Job.As a Data Engineer, you will play a critical role in ensuring the reliability, availability, and performance of our systems an...Show moreLast updated: 12 hours ago
- Promoted
Engineer
Alp Consulting Ltd.nagpur, maharashtra, in As a GCP Data Engineer, you will be responsible for designing, building, and maintaining scalable data processing systems on.
You will collaborate with cross-functional teams to ensure data is acces...Show moreLast updated: 20 days ago
- Promoted
Data Engineer
TechVeritonagpur, maharashtra, in You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights.
The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 1 day ago
- Promoted
2855 - Data Engineer
EXLnagpur, maharashtra, in We are looking for an experienced Data Engineer to drive the development of scalable, secure, and high-performance data solutions.
This role requires deep technical expertise in Python, Apache Spark...Show moreLast updated: 1 day ago
- Promoted
- New!
Scala Spark Developer
LTIMindtreeindia, India Competitive / Paid in Indian Rupee.What You Should Know About This Job.Apache Spark, Big Data Hadoop Ecosystem, SparkSQL, Scala).
Hands-on experience in design and development of big data platform.D...Show moreLast updated: 12 hours ago
- Promoted
Senior Data Engineer
Otomeyt AIIndia, India We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago
- Promoted
Data Engineer
Otomeyt AIIndia, India We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
- Promoted
GCP Data Engineer
TEKsystemsNagpur, IN We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant).
Looking for immediate joiners • •.Onboard new data sources - negotiate, agre...Show moreLast updated: 9 days ago
- Promoted
Data Engineer
Innodata Inc.Nagpur, IN CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago
- Promoted
Data Engineer (Spark Scala)
Tata Consultancy ServicesIndia Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill - Data Engineer ( Spark Scala) Exp range – 5 yrs – 10 yrs Location- Chennai / Pune / Bangalore / Hyderabad / Delhi Notice...Show moreLast updated: 8 days ago
- Promoted
Data Engineer
ACL Digitalnagpur, maharashtra, in Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable.
Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
- Promoted
- New!
AWS Data Engineer
Epergne Solutionsnagpur, India Pune / Hyderabad / Chennai / Mysuru / Bhubaneswar / Mangalore / Trivandrum / Chandigarh / Jaipur / Nagpur / Indore / Gurgaon.
Design, build, and optimize data pipelines and scalable data assets.Develop and maintain high-...Show moreLast updated: 12 hours ago
- Promoted
- New!
Big Data Engineer (Spark | AWS | Scala / Java)
Sky Systems, Inc. (SkySys)India, India Full-Time Contract (40hrs / week).Hybrid - Hyderabad, India (3x days onsite / week).Big Data Engineer (5+ years’ experience).
Experian’s dynamic data engineering team.You will design and optimize scalab...Show moreLast updated: 7 hours ago
- Promoted
- New!
Java Spark Developer
LTIMindtreeindia, India Competitive / Paid in Indian Rupee.What You Should Know About This Job.Hadoop Spark SparkSQL - Java (Apache Spark, Big Data Hadoop Ecosystem, Java, SparkSQL).
Experience in Java programming language...Show moreLast updated: 11 hours ago