This job offer is not available in your country.

PySpark Scala Developer - Consultant / Senior Consultant

Talent Worxbangalore, India

9 hours ago

Job description

Role : Spark Scala Developer

Experience : 3–8 years

Location : Bengaluru

Employment Type : Full-time

What We’re Looking For

We’re hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and / or in the cloud. You should know how to write production-grade Spark applications, fine-tune performance, and work fluently with Scala’s functional style. Experience with cloud platforms and modern data tools like Snowflake or Databricks is a strong plus.

Your Responsibilities

Design and develop scalable data pipelines using Apache Spark and Scala
Optimize and troubleshoot Spark jobs for performance (e.g. memory management, shuffles, skew)
Work with massive datasets in on-prem Hadoop clusters or cloud platforms like AWS / GCP / Azure
Write clean, modular Scala code using functional programming principles
Collaborate with data teams to integrate with platforms like Snowflake, Databricks, or data lakes
Ensure code quality, documentation, and CI / CD practices are followed

Requirements

Must-Have Skills

3+ years of experience with Apache Spark in Scala

Deep understanding of Spark internals—DAG, stages, tasks, caching, joins, partitioning

Hands-on experience with performance tuning in production Spark jobs

Proficiency in Scala functional programming (e.g. immutability, higher-order functions, Option / Either)

Proficiency in SQL

Experience with any major cloud platform : AWS, Azure, or GCP

Nice-to-Have

Worked with Databricks, Snowflake, or Delta Lake

Exposure to data pipeline tools like Airflow, Kafka, Glue, or BigQuery

Familiarity with CI / CD pipelines and Git-based workflows

Comfortable with SQL optimization and schema design in distributed environments

Benefits

Work with one of the Big 4's in India

Healthy work Environment

Work Life Balance

Create a job alert for this search

Senior Consultant • bangalore, India