Sunware Technologies - Technical Lead - Apache Spark/Scala

Job Title: Tech Lead Apache Spark Scala

Location: Chennai

Experience: 6+ Years

Job Summary:

We are looking for an experienced Tech Lead Apache Spark Scala with strong expertise in Apache Spark (Scala) and the Azure Data Platform to lead the development of scalable data engineering solutions. The ideal candidate should have hands-on experience in building high-performance data pipelines, mentoring teams, and delivering enterprise-grade data platforms.

Key Responsibilities:

- Lead the development of big data pipelines using Apache Spark (Scala).

- Design and implement data solutions on Azure (Databricks, ADF, ADLS, Synapse).

- Optimize Spark jobs for performance and scalability.

- Lead and mentor a team of engineers.

- Collaborate with business stakeholders and cross-functional teams to deliver quality solutions.

Required Skills:

- Strong Hands on experience with both Apache Spark & Scala

- Expertise in Azure Data Platform (Azure Databricks, ADF, ADLS, Synapse)

- Experience in ETL/ELT pipelines & distributed systems

- Strong SQL and data modeling knowledge

- Experience in performance tuning of Spark jobs

- Familiarity with CI/CD, Git, Azure DevOps

- Strong leadership, communication, and stakeholder management skills

- Experience working in Agile/Scrum environments

Educational Qualification:

- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.

(ref:hirist.tech)