Sr. Databricks Developer

The Senior Databricks Developer will be responsible to implement and maintain solutions in AWS Databricks platform. You will be responsible for coordinating data requests from the various teams reviewing and approving efficient approaches to ingest extract transform and maintaining data in multi-hop addition youll work with team members to mentor other developers to grow their knowledge and expertise. Youll be working in a fast-paced and high-volume processing environment where quality and attention to detail are vital.

PRIMARY RESPONSIBILITIES

Design and develop high performance and secured Databricks solutions using Python Spark PySpark Delta tables UDP and Kafka

Create high-quality technical documents including data mapping data processes and operational support guides

Translate business requirements into data model design and technical solutions

Develop data ingest pipelines using Python Spark & PySpark to support near real-time and batch ingestion processes

Maintain data lake and pipeline processes which includes troubleshooting issues performance tuning and making data quality improvements

Work closely with technical leaders product managers and reporting team to gather functional and system requirements

Work in fast pace environment and perform effectively in an agile development environment

KNOWLEDGE AND SKILL REQUIREMENTS

Bachelors degree in Computer Science or Information Systems or equivalent degree

Must have 5 years of experience in developing applications using Python Spark PySpark Java Junit Maven and its eco-system

Must have 4 years of hands-on experience in AWS Databricks and related technologies like MapReduce Spark Hive Parquet and AVRO

Good experience in end-to-end implementation of DW BI projects especially in data warehouse and data mart developments

Extensive hands on RDD Data frame and Dataset operations of Spark 3.x

Experience with design and implementation of ETL / ELT framework for complex warehouses / marts.

Knowledge of large data sets and experience with performance tuning and troubleshooting

Plus to have AWS Cloud Analytics experience in Lambda Athena S3 EMR Redshift Redshift spectrum

Must have RDBMS : Microsoft SQL Server Oracle MySQL

Familiarity with Linux OS

Understanding of Data architecture replication and administration

Experience in working with real-time data ingestion with any streaming tool

Strong debugging skills to troubleshoot production issues

Comfortable working in a team environment

Hands on experience with Shell Scripting Java and SQL

Ability to identify problems and effectively communicate solutions to peers and management

Labcorp is proud to be an Equal Opportunity Employer :

Labcorp strives for inclusion and belonging in the workforce and does not tolerate harassment or discrimination of any kind. We make employment decisions based on the needs of our business and the qualifications and merit of the individual. Qualified applicants will receive consideration for employment without regard to race religion color national origin sex (including pregnancy childbirth or related medical conditions) family or parental status marital civil union or domestic partnership status sexual orientation gender identity gender expression personal appearance age veteran status disability genetic information or any other legally protected characteristic. A dditionally all qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law.

We encourage all to apply

If you are an individual with a disability who needs assistance using our online tools to search and apply for jobs or needs an accommodation please visit our accessibility siteor contact us at Labcorp Accessibility. Formore information about how we collect and store your personal data please see our Privacy Statement.

Required Experience :

Senior IC

Key Skills

CCTV,Computer Science,Corporate Marketing,E Learning,Arabic English Translation

Employment Type : Full-Time

Experience : years

Vacancy : 1