Databricks Admin

You will play a critical role in building the modern cloud data platform for DS by leveraging your in-depth technical expertise and interpersonal skills. In this role, you will be required to focus on accelerating the digital product development as part of the DSP DPE team and will complete DataOps and Databricks administration activities.

One of the key success criteria for this role is to ensure the stability and security of the data analytical workspaces and uninterrupted running of data processing pipelines.

Responsibilities :

Configure and deploy Databricks Analytical workspaces in Azure with IaC (Terraform, Databricks API) with J&J DevOps automation tools within JPM / Xena framework.

Work with platform data engineering, core platform, security, and technical quality to deploy data pipelines.

Design, implement, and support data monitoring solutions in data analytical workspaces that leverage modern Spark data processing architectures such as Databricks, Delta Live Table (DLT) technology, and Databricks Unity catalog for data governance.

Implement and support security monitoring solutions within Azure Databriks ecosystem. Enforce security controls for all the systems components.

Operate in SAFe Agile DevOps principles and methodology in building quality DSP technical solutions. Author and execute automated test scripts as mandates DSP quality requirements .

Provide ongoing administrative support for DSP Databricks workspaces.

Qualifications : Required :

Bachelor’s Degree, preferably in software or computer science

7+ years of overall IT experience

5+ years of experience in cloud computing and data systems

Experience in design and implementation of secure Azure data solutions.

Expert level in DataOps and ability to design and deploy data security and monitoring solutions.

Proficiency with enterprise DevOps tools including Bitbucket, Jenkins, Artifactory.

Expert level in configuration and administration Azure Databricks workspaces and Databricks Unity Catalog.

Proficiency in data engineering and software development (Python).

Deep understanding of principles of modern data Lakehouse.

Good working knowledge of Spark.

Deep understanding of Azure data security and ability to implement the required controls for building secure and compliant data processing pipelines.

Ability to operate and experience in the Agile framework.

Ability to analyze and make data driven decisions.

Ability to define and implement prototypes and proofs of concepts.

Understanding of SDLC phases and design control processes.

Preferred :

Master’s Degree, preferably in software or computer science.

Azure Databricks Certified Associate Platform Administrator.

Azure Databricks Certified Data Engineer.

Ability to analyze use cases and translate them into system requirements.

Knowledge of software architecture and automated testing.

Excellent verbal and written communication skills.