This job offer is not available in your country.

Lead Data Engineer - Java / Spark

CliqHRPune

10 days ago

Job description

We are seeking an experienced Lead Data Engineer to design, build, and optimize large-scale data solutions. This role involves working with modern cloud and big data technologies to enable data-driven decision-making, while leading initiatives that ensure scalability, reliability, and efficiency.

Key Responsibilities :

Lead the design and deployment of scalable data processing solutions on AWS using Java and Spark.
Architect and implement big data pipelines with Apache Spark on AWS EMR.
Develop and deploy Serverless applications using AWS Lambda and integrate with other AWS services.
Manage containerized applications with Amazon EKS for microservices orchestration.
Design and implement workflow orchestration with Apache Airflow for complex data pipelines.
Collaborate with cross-functional teams to ensure data solutions meet business needs.
Mentor junior engineers and drive best practices in data engineering.

Key Skills & Qualifications :

8-12 years of experience in data engineering with leadership responsibilities.

Strong expertise in AWS (EMR, Lambda, EKS) and big data technologies (Java, Spark).

Hands-on experience with Apache Airflow for orchestration.

Strong problem-solving and architectural design skills.

Excellent communication and leadership abilities.

Ability to thrive in hybrid working environments.

(ref : hirist.tech)

Create a job alert for this search

Lead Data Engineer • Pune