This job offer is not available in your country.
Scala / Spark Developer - Chennai
Photonchennai, India4 hours ago
Job descriptionDevelop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. Implement version control and CI / CD pipelines for Spark applications.
Required Skills & Experience :
- Minimum 8 years of experience in application development.
- Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing.
- Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.
- Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi.
- Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data.
- Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL.
- Knowledge of data warehousing concepts, dimensional modeling, and data lakes.
- Ability to troubleshoot and optimize Spark and Cloudera platform performance.
- Familiarity with version control tools like Git and CI / CD tools (., Jenkins, GitLab).
Create a job alert for this search
Developer Chennai • chennai, India
Related jobs
%20Ltd)
- Promoted
- New!
Spark Scala Developer
Tata Consultancy ServicesChennai, Tamil Nadu, India TCS is looking for Spark Scala Developer.Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow.
Good code and configuration spark knowledge (at least ...Show moreLast updated: 3 hours ago
- Promoted
- New!
Snaplogic
Virtusachennai, India Snaplogic - CREQ Description Strong working knowledge of modern programming languages, ETL / Data Integration tools (preferably SnapLogic) and understanding of Cloud Concepts.Expert in modern techno...Show moreLast updated: 4 hours ago
- Promoted
- New!
Scala Developer
ACL DigitalChennai, IN Acl digital is hiring for remotely for.Senior Scala Software Engineer.Job Title : Senior Scala Software Engineer.Design, develop, test, and document modules / features for Blue Planet Inventory and Or...Show moreLast updated: 3 hours ago
- Promoted
- New!
Sr. Spark Developer
Anicalls (Pty) Ltdchennai, India Understanding of different types of testing – Unit, Acceptance, Regression, Performance, etc.Proficiency working with large data stores.
Test Driven Development (TDD) or Pair Programming.Deep unders...Show moreLast updated: 4 hours ago
- Promoted
- New!
Pyspark Developer
12542 Citicorp Services India Private Limitedchennai, India Encompassing a broad range of specialties, roles, and cultures, our teams are creating innovations used across the globe.
Citi is constantly growing and progressing through our technology, with lase...Show moreLast updated: 4 hours ago
- Promoted
- New!
Snaplogic Developer
Virtusachennai, India Snaplogic Developer - CREQ Description Strong working knowledge of modern programming languages, ETL / Data Integration tools (preferably SnapLogic) and understanding of Cloud Concepts.Expert in mod...Show moreLast updated: 4 hours ago
- Promoted
- New!
Spark Scala Developer
Infotel UKchennai, India Position : Spark Scala Developer.At Infotel UK, a premier technology consulting firm, we are seeking a skilled Spark Scala Developer to join our dynamic team.
In this role, you will leverage your exp...Show moreLast updated: 4 hours ago
- Promoted
- New!
PySpark Developers
Techno Wisechennai, India This to build a data standardized and curation layer that will integrate data across internal and external sources, provide analytical insights and integrate with customer’s critical systems.Abilit...Show moreLast updated: 4 hours ago
- Promoted
- New!
Bigdata developer - 7+ years in Spark with Scala / Java(Mumbai, Pune, Chennai, Indore, Bangalore, Kolkata)
Tata Consultancy Serviceschennai, India Competitive / Paid in Indian Rupee.What You Should Know About This Job.Mumbai, Pune, Chennai, Indore, Bangalore, Kolkata.
Required Technical Skill : Hadoop + Spark with Scala / Java.Spark with Java / Sc...Show moreLast updated: 4 hours ago
- Promoted
- New!
Databricks Developer
Maneva Consulting Pvt. Ltdchennai, India Job Title - Databricks Analyst.Must have strong working experience with.Azure Databricks, PySpark Notebooks , Spark SQL and Unity Catalog.
Must have strong working experience with.If you are excited...Show moreLast updated: 4 hours ago
- Promoted
Senior Developer
Datacore Technologieschennai, tamil nadu, in Required Skills for Role for Sr.Grafana - at least 6+ Years of experience in administering Grafana and create dashboards and alerts.
Requires expertise on skill set for below Create dashboards in Gr...Show moreLast updated: 7 days ago
- Promoted
Scala Developer - PySpark
Techmynd ConsultingChennai Pyspark, Scala Developer Location : Bangalore, Chennai Experience : 6- 8 Years Show moreLast updated: 30+ days ago
- Promoted
- New!
Scala Developer
Tata Consultancy ServicesChennai, IN Scala - Microservice Developer.Tata Consultancy Services is an IT services, consulting and business solutions organization that has been partnering with many of the world’s largest businesses in th...Show moreLast updated: 3 hours ago
- Promoted
- New!
Java Spark Lead
Anicalls (Pty) Ltdchennai, India Core Java and 5+ years experience in technologies (Hadoop, Spark, and Big Data platforms, RBDMS, NoSQL).Advanced SQL capabilities are required.
Good Knowledge of database design techniques and exper...Show moreLast updated: 4 hours ago
- Promoted
- New!
Kafka / Cloudera Developer
Anicalls (Pty) Ltdchennai, India Thorough understanding of Hadoop, Spark, and ecosystem components.Knowledge of Linux and shell scripting is a must.Sound knowledge on Scala or JAVA.
Experience working with a Streaming platform spec...Show moreLast updated: 4 hours ago
- Promoted
- New!
Pyspark Developer (Bangalore, Chennai, Kolkata, Hyderabad, Pune)
Tata Consultancy ServicesChennai, Tamil Nadu, India Location : Bangalore, Chennai, Kolkata, Hyderabad, Pune.Functional Skills : Experience in Credit Risk / Regulatory risk domain.
Technical Skills : Spark ,PySpark, Python, Hive, Scala, MapReduce, Unix she...Show moreLast updated: less than 1 hour ago
- Promoted
- New!
Scala Developer
Infotel UKchennai, India Infotel India, a leading technology solutions provider, is on the lookout for a talented Scala Developer to join our innovative team.
The ideal candidate will have a strong background in software de...Show moreLast updated: 4 hours ago
- Promoted
- New!
Sr. Spark / Scala Engineer
Anicalls (Pty) Ltdchennai, India Coordinate Development, Integration, and Production deployments.Optimize Spark code, Impala queries, and Hive partitioning strategy for better scalability, reliability, and performance.Build applic...Show moreLast updated: 4 hours ago