Principal Consultant- Databricks Developer and ETL

Inviting applications for the role of Principal Consultant- Databricks Developer and ETL!

In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. You would be part of the data integrity / analysis team in the Banking and financial

domain. You will be responsible to independently build data analysis around complex business problems from data available in the client owned or accessible systems. For these tasks, you would be encouraged to understand the business ask / problem, assess the scope, quantity and quality of the available data, prepare and build the code using Pyspark / Databricks, Python programming and loading data in to DWH and Data Mart for downstream

consumption team.

Responsibilities

• . Extensive hands-on experience on Python (Pyspark) and Pyspark with SQL
• . The experience shall be to carry RDDs, Struct types and more on pyspark
• . Exposure to work on Databricks notebook for Pyspark and pyspark with sql coding
• . Good hands on to collaborate with AWS services using Python.
• . Experience with cloud technologies like AWS (S3, Redshift,SNS)
• . Expertise in developing ETL and batch processes to support data movement
• . Candidate shall be good in communication and SELF - Driven
• . May work in silos with his own deliverables and discussion points with onshore

customer.

Qualifications we seek in you!

Minimum Qualifications / Skills

Preferred Qualifications

Candidate must have good communication skills and client handling