Cyber Data Engineer

Description

: Data Engineer

The IT Metrics & Analytics team within the Technology Data & Analytics group (TDA-ITMA) delivers business intelligence and predictive analytics insights across the NT IT and corporate data landscape. This service enables simplified access across commonly needed datasets throughout the IT organization and beyond. The team works in an Agile fashion to deliver value to our clients quickly and incrementally.

ITMA team currently uses Azure cloud as their data store and analytic platform. Uses ADF and synapse pipelines, Pyspark and data bricks to process and curate data. Python programming to integrate new and varied data sources. And is currently exploring various AI options for optimization and orchestration of end-to-end processes.

Responsibilities :

Architecture & Design :

Design and build robust, scalable data solutions and modern data platforms on Azure.

Data Pipeline Development :

Create and optimize ETL / ELT data pipelines, processing both batch and streaming data using tools like Azure Data Factory and Azure Synapse.

Data Platform Management :

Build and maintain data lakes, data warehouses, and other data storage solutions using Azure Storage and Data factory.

Collaboration :

Work with cross-functional teams, including business consultants, data architects, data scientists, and application developers.

Mentorship :

Guide and mentor junior data engineers, fostering best practices and continuous learning.

Data Governance :

Implement data governance and access control to ensure data accuracy, consistency, and security.

Technical Leadership :

Lead end-to-end development efforts, troubleshoot data issues, and stay updated on industry trends and new Azure services.

Agile & DevOps :

Drive development using Agile methodologies and implement CI / CD practices for efficient delivery.

Required Skills & Qualifications

Azure Services :

Deep expertise in Azure Synapse Analytics, Azure Data Factory, Azure Storage, and preferably Azure Data factory / Fabrics or Databricks.

Programming :

Strong coding skills in Python / PySpark for data processing and automation.

SQL :

Advanced proficiency in SQL, including writing, optimizing, and troubleshooting complex queries.

Data Modeling :

Solid understanding of data modeling, data warehousing concepts (dimensional modeling, CDC, SCDs), and data lakes.

Databases & Storage :

Experience with relational and non-relational databases, data streams, and various file formats.

Soft Skills :

Excellent communication (verbal and written), strong analytical and problem-solving abilities, and leadership skills.

Experience :

1o + years of experience in data engineering, with a proven track record of delivering complex data solutions.

Education

Bachelor’s or master’s degree in computer or data program or related experience.

Working with Us :

As a Northern Trust partner, greater achievements await. You will be part of a flexible and collaborative work culture in an organization where financial strength and stability is an asset that emboldens us to explore new ideas.

Movement within the organization is encouraged, senior leaders are accessible, and you can take pride in working for a company committed to assisting the communities we serve! Join a workplace with a greater purpose.

We’d love to learn more about how your interests and experience could be a fit with one of the world’s most admired and sustainable companies! Build your career with us and apply today. #MadeForGreater

Reasonable accommodation

Northern Trust is committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation for any part of the employment process, please email our HR Service Center at .

We hope you’re excited about the role and the opportunity to work with us. We value an inclusive workplace and understand flexibility means different things to different people.

Apply today and talk to us about your flexible working requirements and together we can achieve greater.

About Our Pune Office

The Northern Trust Pune office, established in 2016, is now home to over 3,000 employees. The office handles various functions, including Operations for Asset Servicing and Wealth Management, as well as delivering critical technology solutions that support business operations across the globe.

Our Pune team takes our commitment to service to heart. In 2024, they volunteered more than 10,000+ hours into the communities where they live and work.