Databricks Workspace Engineer

You will play a critical role in building the modern cloud data platform for DS by leveraging your in-depth technical expertise and interpersonal skills. In this role, you will be required to focus on accelerating the digital product development as part of the DSP DPE team and will complete DataOps and Databricks administration activities.

One of the key success criteria for this role is to ensure the stability and security of the data analytical workspaces and uninterrupted running of data processing pipelines.

Responsibilities :

• Configure and deploy Databricks Analytical workspaces in Azure with IaC (Terraform, Databricks API) with J&J DevOps automation tools within JPM / Xena framework.
• Work with platform data engineering, core platform, security, and technical quality to deploy data pipelines.
• Design, implement, and support data monitoring solutions in data analytical workspaces that leverage modern Spark data processing architectures such as Databricks, Delta Live Table (DLT) technology, and Databricks Unity catalog for data governance.
• Implement and support security monitoring solutions within Azure Databriks ecosystem. Enforce security controls for all the systems components.
• Operate in SAFe Agile DevOps principles and methodology in building quality DSP technical solutions. Author and execute automated test scripts as mandates DSP quality requirements .
• Provide ongoing administrative support for DSP Databricks workspaces.

Qualifications : Required :

Preferred :