This job offer is not available in your country.

Big Data Engineer (Spark | AWS | Scala / Java)

Sky Systems, Inc. (SkySys)Kolkata, IN

6 hours ago

Job description

Role : Big Data Engineer

Position Type : Full-Time Contract (40hrs / week)

Contract Duration : Long Term

Work Schedule : 8 hours / day (Mon-Fri)

Location : Hybrid - Hyderabad, India (3x days onsite / week)

We are looking for a skilled Big Data Engineer (5+ years’ experience) to join Experian’s dynamic data engineering team. You will design and optimize scalable data pipelines, APIs, and big data solutions on AWS to support our global data ecosystem.

Key Responsibilities :

Build and maintain scalable data pipelines with Spark / PySpark, Hadoop, and AWS (EMR, EC2, ECS) .
Develop and integrate RESTful APIs and AWS Gateway services using Scala / Java .
Ensure data quality, performance, and reliability across platforms.
Collaborate with cross-functional teams and support CI / CD deployment processes.

Must-Haves :

5+ years of experience in Big Data Engineering.

Strong skills in Spark / PySpark, Hadoop, AWS (EMR, EC2, ECS) .

Proficiency in Scala / Java for backend / API development.

Solid understanding of RESTful APIs and Git / CI / CD pipelines.

Nice-to-Haves :

Experience in data security, real-time processing, and data lake architectures .

Familiarity with Docker / Kubernetes .

Create a job alert for this search

Big Data Engineer • Kolkata, IN