Big Data Developer

Experience : 5 - 9 Years

Location : Bangalore / Pune / Hyderabad

WorkMode : WFO (Hybrid)

Note : Should be open for short / medium-term travel opportunities within India & foreign location

Technical Skills

Must Have :

• Java (primary backend development language)
• Kafka (real-time messaging and streaming)
• Big Data Processing (Spark, distributed systems)
• Strong backend architecture & microservices design
• Azure (preferred) or any major cloud (AWS, GCP)
• SQL Databases (Postgres or equivalent)
• NoSQL Databases (Elasticsearch, MongoDB, or similar)
• Python (secondary scripting / data workflows)
• Kubernetes & Docker (containerization and orchestration)

Good to Have (Optional) :

Roles and Responsibilities

Backend Development (Scala focus)

Build and maintain high-performance, scalable backend services using Scala.

Design APIs, microservices, and distributed backend systems.

Implement clean, maintainable, and test-driven code (TDD / BDD).

Data Engineering & Processing

Design and implement data pipelines with Spark, Kafka, and distributed storage systems.

Integrate SQL / NoSQL databases for backend and analytics needs.

Incorporate data quality checks, lineage, and governance in pipelines.

Cloud-Native Engineering

Deploy, operate, and scale services on Kubernetes and Docker.

Implement CI / CD pipelines and DevOps best practices.

Ensure reliability, observability, and monitoring of deployed services.

Client Engagement & Consulting

Advise clients on backend system design and distributed storage / compute options.

Present trade-offs between different modeling and architecture approaches.

Encourage collaboration and agile practices between teams.

Architecture & End-to-End Solutions

Drive discussions on backend scalability, fault tolerance, and high availability.

Ensure solutions align with business goals and client objectives.