Talent.com
This job offer is not available in your country.
Big Data Engineer - Spark / Scala

Big Data Engineer - Spark / Scala

Strategic HR SolutionsMumbai
27 days ago
Job description

Spark Scala Developer

Location : Bengaluru, Mumbai

Employment Type : Full-time

What Were Looking For

Were hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and / or in the cloud. You should know how to write production-grade Spark applications, fine-tune performance, and work fluently with Scalas functional style. Experience with cloud platforms and modern data tools like Snowflake or Databricks is a strong plus.

Your Responsibilities :

  • Design and develop scalable data pipelines using Apache Spark and Scala
  • Optimize and troubleshoot Spark jobs for performance (e.g. memory management, shuffles, skew)
  • Work with massive datasets in on-prem Hadoop clusters or cloud platforms like AWS / GCP / Azure
  • Write clean, modular Scala code using functional programming principles
  • Collaborate with data teams to integrate with platforms like Snowflake, Databricks, or data lakes
  • Ensure code quality, documentation, and CI / CD practices are followed

Must-Have Skills :

  • 3+ years of experience with Apache Spark in Scala
  • Deep understanding of Spark internalsDAG, stages, tasks, caching, joins, partitioning
  • Hands-on experience with performance tuning in production Spark jobs
  • Proficiency in Scala functional programming (e.g. immutability, higher-order functions, Option / Either)
  • Proficiency in SQL
  • Experience with any major cloud platform : AWS, Azure, or GCP
  • Nice-to-Have :

  • Worked with Databricks, Snowflake, or Delta Lake
  • Exposure to data pipeline tools like Airflow, Kafka, Glue, or BigQuery
  • Familiarity with CI / CD pipelines and Git-based workflows
  • Comfortable with SQL optimization and schema design in distributed environments
  • (ref : hirist.tech)

    Create a job alert for this search

    Big Data Engineer • Mumbai

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIKalyan-Dombivli, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesMumbai, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Thane, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 23 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Texplorers Incthane, maharashtra, in
    We are seeking a skilled Data Engineer with proficient knowledge in Spark and SQL.The ideal candidate will be responsible for designing,. Data Pipeline Development : Design, develop, and maintain sca...Show moreLast updated: 17 days ago
    • Promoted
    Big Data Engineer - Scala / Spark / Python

    Big Data Engineer - Scala / Spark / Python

    Idyllic Services Pvt LtdMumbai
    Job Title : Big Data Engineer - Scala Experience : 7 to 10Years (Minimum 3+ years in Scala) Notice Period : ...Show moreLast updated: 20 days ago
    • Promoted
    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    USTdombivli, maharashtra, in
    CTC, notice period, and current location details to.Apache Hadoop, Airflow, Kubernetes, and Containers.Troubleshoot Hadoop log files and work with. Required Skills & Qualifications : .Scala, Spark, Py...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tredence Inc.navi mumbai, maharashtra, in
    Design, build, and maintain scalable data pipelines using DBT and Airflow.Develop and optimize SQL queries and data models in Snowflake. Implement ETL / ELT workflows, ensuring data quality, performan...Show moreLast updated: 29 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Infogaindombivli, maharashtra, in
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Big Data Technologies

    Data Engineer - Big Data Technologies

    HyreSnapMumbai
    Job Description : Responsibilities : - Design, execution, and management of a large and complex distributed data syste...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIThane, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 16 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisMumbai, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivedombivli, maharashtra, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 2 days ago
    • Promoted
    GCP Big Data Engineer

    GCP Big Data Engineer

    Talentmaticsthane, maharashtra, in
    The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 3 days ago
    • Promoted
    Lead Data Engineer - Python / Big Data

    Lead Data Engineer - Python / Big Data

    HyreSnapMumbai
    Responsibilities : - Design, execution, and management of a large and complex distributed data system.Monitoring of performance and optimizing existing proje...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    R SystemsMumbai, IN
    Offshore candidates accepted (Singapore Based Company).Please don't apply if less than 4 years exp in Data Engineer).ETL pipelines, real-time streaming, and data transformations.RDDs, transformatio...Show moreLast updated: 24 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKalyan-Dombivli, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    HISH IT SERVICESKalyan-Dombivli, IN
    Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 4 days ago
    • Promoted
    Data Platform Engineer-Hybrid / Mumbai / Contract

    Data Platform Engineer-Hybrid / Mumbai / Contract

    ideaHelixmumbai, maharashtra, in
    Strong Software Engineering Skills.Solid programming expertise, especially in Python, with strong fundamentals in.Proven problem-solving ability with a focus on writing clean, maintainable, and.Dee...Show moreLast updated: 2 days ago