Talent.com
This job offer is not available in your country.
Data Platform Engineer

Data Platform Engineer

ConfidentialBengaluru / Bangalore
30+ days ago
Job description

Role Purpose

A result-oriented Software Developer to develop solutions powered by Fujitsus new processor, which helps solve real-world challenges facing society and businesses across different industries. As a software developer, you are passionate about developing solutions and should be comfortable with back-end coding languages, technologies, frameworks and third-party / opensource libraries. You will play a role in developing innovative advanced solutions and services to support business outcomes.

Responsibilities

  • Improve and analyze performance of software applications.
  • Enable and optimize OSS / ISV applications for Fujitsus new processor, starting with AI and Big Data Analytics-related applications.
  • Develop new algorithms for Big Data Analytics frameworks, tuning technologies and work on software based on the proposed approaches using Big Data engineering.
  • Designing and developing data analysis workflows, applications, effective APIs and the system architectures
  • Deploying and Testing applications to ensure functionality, performance, responsiveness, and efficiency.
  • Creating test cases, test plans and automated test scripts for unit tests
  • Troubleshooting, debugging, and fixing bugs and upgrading software / applications.
  • Creating security and data protection settings and measures
  • Writing technical documentation
  • Working and communicating well with product managers, business analysts, and data scientists, and other software developers to collaborate, review and deliver high quality applications.
  • Learning continually, sharing knowledge, and fostering exchange of skills
  • Working using agile methods (planning meetings, review meetings, standup meetings, development, etc.)
  • Working on multiple projects at once while keeping focused on project timeline

Experience

You will be able to demonstrate that you have :

  • Degree in computer science or relevant field
  • Proven experience as a software developer or similar role, and familiarity with common stacks for software applications using Data analytics technologies.
  • Minimum 4 years experience in production application / solution development
  • Experience in Big Data using Databricks, PySpark etc. and statistical analysis with Data Analytics tools and technologies.
  • Experience with Data Intelligence Platforms, Large Scale Distributed processing with Spark
  • Understanding of Java, JVM, VectorAPI, HotSpot, JNI, Vectorization techniques & SIMD optimization
  • Knowledge of Spark Accelerator frameworks like Comet, Velox, TrinoDB, ClickHouse etc.
  • Knowledge of ETL (AWS Glue, etc.) & database (RDB, Vector DB, etc.)
  • Knowledge related to DWH Ecosystem (Palantir, Snowflake, Databricks, BigQuery, Redshift, etc.)
  • Experience with SQL / Postgres SQL / Python data processing with SW Development Skills in Java / C++ / Scala ( especially Java )
  • Experience in data analysis using parallel processing. (Apache Spark, PySpark etc.)
  • In depth understanding and knowledge of the specified data analytic tools and technologies with Framework engineering experience.
  • Proficiency with fundamental back-end server-side languages such as Python, C / C++, etc.
  • Knowledge of OSS as an alternative to cloud computing for each layer
  • Excellent writing, verbal communication, and teamwork skills
  • Experience in Big Data using Databricks, PySpark etc. and statistical analysis with Data Analytics tools and technologies.
  • Experience in software development in agile approach
  • Excellent writing, verbal communication, and teamwork skills

    • Preferred Experience

    You will be able to demonstrate that you have :

  • Experience in developing and deploying APIs.
  • Preferred experience in performance tuning & optimization techniques for Data Analytics tools, SQL, and NoSQL databases.
  • Knowledge and experience in Cloud service (Azure / AWS) features such as Functions, VM, Container, DevOps (CI / CD)
  • Great skills in evaluating performance and security of software applications and delivering solutions which are efficient and performant.
  • HPC and computer architecture understanding.
  • Skills in AI-related technology

    • Role :   Data Platform Engineer

    Industry Type :   Analytics / KPO / Research

    Department :   Engineering - Software & QA

    Employment Type :   Full Time, Permanent

    Role Category :   Software Development

    Education

    UG :   B.Tech / B.E. in Any Specialization

    Skills Required

    Java, Big Data, Py Spark, Apache Spark, Sql, Python, Cloud Computing

    Create a job alert for this search

    Data Platform Engineer • Bengaluru / Bangalore