Big Data Engineer (Spark | AWS | Scala / Java)

Role : Big Data Engineer

Position Type :

Full-Time Contract (40hrs / week)

Contract Duration : Long Term

Work Schedule

: 8 hours / day (Mon-Fri)

Location

: Hybrid - Hyderabad, India (3x days onsite / week)

We are looking for a skilled

Big Data Engineer (5+ years’ experience)

to join Experian’s dynamic data engineering team. You will design and optimize scalable data pipelines, APIs, and big data solutions on AWS to support our global data ecosystem.

Key Responsibilities :

Build and maintain scalable data pipelines with

Spark / PySpark, Hadoop, and AWS (EMR, EC2, ECS)

Develop and integrate

RESTful APIs

and AWS Gateway services using

Scala / Java

Ensure

data quality, performance, and reliability

across platforms.

Collaborate with cross-functional teams and support

CI / CD deployment

processes.

Must-Haves :

5+ years of experience in Big Data Engineering.

Strong skills in

Spark / PySpark, Hadoop, AWS (EMR, EC2, ECS)

Proficiency in

Scala / Java

for backend / API development.

Solid understanding of

RESTful APIs

and Git / CI / CD pipelines.

Nice-to-Haves : Experience in

data security, real-time processing, and data lake architectures

Familiarity with

Docker / Kubernetes