This job offer is not available in your country.

Senior Data Engineer

ThoughtFocusMumbai, IN

3 days ago

Job description

Senior Data Engineer Role

Position Overview

Experienced Data Engineer to design, build, and optimize scalable data pipelines and infrastructure. The ideal candidate will be responsible for ensuring reliable data flow across systems, enabling analytics and business intelligence teams with high-quality, accessible datasets

Key Responsibilities

Develop and implement efficient data pipelines and ETL processes to migrate and manage client, investment, and accounting data in Databricks
Work closely with the investment management team to understand data structures and business requirements, ensuring data accuracy and quality.
Monitor and troubleshoot data pipelines, ensuring high availability and reliability of data systems.
Optimize database performance by designing scalable and cost-effective solutions.

Candidate Profile

Experience : Over all 7+ Years

5+ years of experience in data engineering or a similar role.

Proficiency in Apache Spark. Databricks Data Cloud, including schema design, data partitioning, and query optimization

Exposure to Azure.

Exposure to Streaming technologies. (e.g Autoloader, DLT Streaming)

Advanced SQL, data modeling skills, and data warehousing concepts tailored to investment management data (e.g., transaction, accounting, portfolio data, reference data etc).

Experience with ETL / ELT tools like snap logic and programming languages (Python / Scala / R programming).

Familiarity with workload automation and job scheduling tools such as Control M.

Familiar with data governance frameworks and security protocols.

Excellent problem-solving skills and attention to detail.

Strong communication and collaboration skills.

Education

Bachelor’s degree in computer science, IT, or a related discipline.

Create a job alert for this search

Senior Data Engineer • Mumbai, IN