Lead, Data Engineer

Our professionals balance analytical skills, deep market insight and independence to deliver solid, defensible analysis and practical advice to our clients. As an organization, we think globally. We create transparency in an opaque world, and we encourage our people to do the same. That means when you take your place on our team, you'll discover a supportive and collaborative work environment that empowers you to excel. If you're ready to share your perspective with the world, then you can make a real impact here. This is the Kroll difference.

Kroll is building an strong Data practice with artificial intelligence, machine learning practice and analytics, and we're looking for you to join our growing portfolio of . You will be involved in designing, building, and integrating data from various sources and working with an advanced engineering team and professionals from the world's largest financial institutions, law enforcement, and government agencies.

At Kroll, your work will help protect, restore and maximize value for our clients. Join us and together we'll maximize the value of your career.

Responsibilities

• Design and build organizational data infrastructure and architecture
• Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes for data delivery.
• Choose the best tools / services / resources to build robust data pipelines for data ingestion, connection, transformation, and distribution
• Design, develop and manage ELT applications.
• Working with global teams to deliver fault tolerant, high quality data pipelines

Requirements

Desired Skills

Skills Required

Spark SQL, Pyspark, Sql, ELT, Git, Pandas, Docker, Spark, Databricks, FastAPI, Data Governance, Rest Apis, Azure, Python, Kubernetes, Aws, Etl