Talent.com
Lead Data Engineer

Lead Data Engineer

ConfidentialMumbai, India
30+ days ago
Job description

We are M&G Global Services Private Limited (formerly known as 10FA India Private Limited, and prior to that Prudential Global Services Private Limited). We are a fully owned subsidiary of the M&G plc group of companies, operating as a Global Capability Centre providing a range of value adding services to the Group since 2003. At M&G our purpose is to give everyone real confidence to put their money to work. As an international savings and investments business with roots stretching back more than 170 years, we offer a range of financial products and services through Asset Management, Life and Wealth. All three operating segments work together to deliver attractive financial outcomes for our clients, and superior shareholder returns.

M&G Global Services has rapidly transformed itself into a powerhouse of capability that is playing an important role in M&G plc's ambition to be the best loved and most successful savings and investments company in the world.

Our diversified service offerings extending from Digital Services (Digital Engineering, AI, Advanced Analytics, RPA, and BI & Insights), Business Transformation, Management Consulting & Strategy, Finance, Actuarial, Quants, Research, Information Technology, Customer Service, Risk & Compliance and Audit provide our people with exciting career growth opportunities. Through our behaviours of telling it like it is, owning it now, and moving it forward together with care and integrity; we are creating an exceptional place to work for exceptional talent.

Job Description

Job Title

Lead Data Engineer

Grade

2B

Level

Senior Manager – Data

Job Function

Digital Transformation

Job Sub Function

Azure Data Engineering & DevOps & BI

Reports to

3B (VP – Data Engineering)

Location

Mumbai

Business Area

M&G Global Services

Overall Job Purpose

To implement data engineering solutions using latest technologies available in Azure Cloud space conforming to the best in class design standard & agreed requirements to achieve business objective

Accountabilities / Responsibilities

  • Lead data engineering projects to build and operationalize data solutions for business using Azure services in combination with custom solutions – Azure Data Factory, Azure Data Flows, Azure Databricks, Azure Data Lake Gen 2, Azure SQL etc
  • Proven experience on leading a team of data engineers providing technical guidance and ensuring alignment with agreed architectural principles
  • Experience in migrating on-premise data warehouses to data platforms on AZURE cloud
  • Designing and implementing data engineering, ingestion and transformation functions using ADF, Databricks
  • Proficient in Py-Spark
  • Experience in building Python based APIs on Azure Function Apps
  • Experience on Azure Logic apps
  • Experience in Lakehouse / Datawarehouse implementation using modern data platform architecture
  • Capacity Planning and Performance Tuning on ADF & Databricks pipelines
  • Support data visualization development using Power BI
  • Exposure across all the SDLC process, including testing and deployment
  • Experience in relational and dimensional modelling, including big data technologies
  • Experience in Azure DevOps – Build CI / CD pipelines for ADF, ADLS, Databricks, Azure SQL DB etc
  • Experience of working in secured Azure environments using Azure KeyVaults, Service Principals, and Managed Identities
  • Good to have knowledge on Apigee (Googles API Management)
  • Understanding of data masking, encryption and other practices used in handling sensitive data
  • Ability to interact with Business for requirement gathering and query resolutions
  • Working on off shore office based development teams, collaborating within a team environment and participating in typical project lifecycle activities such as requirement analysis, testing and release
  • Develop Azure Data skills within the team through knowledge sharing sessions, articles, etc.
  • Adherence to organisations Risk & Controls requirements
  • Should have skills for Stakeholder management, process adherence, planning & documentationss

Key Stakeholder Management

Internal

Business Teams

Project Manager

Architects

Data Scientists

Team members

External

Knowledge, Skills, Experience & Educational Qualification

Knowledge & Skills :

  • Azure Data Factory,
  • Azure Data Lake Storage V2
  • Azure SQL
  • Azure DataBricks
  • Pyspark
  • Azure DevOps
  • Power BI Report
  • Technical leadership
  • Confidence & excellent communication
  • Experience :

  • Overall 12+ years of experience
  • 5 + Experience on Azure data engineering
  • 5 + experience of managing data deliveries
  • Educational Qualification :

  • Graduate / Post-graduate. Preferably with specialisation in Computer Science, Statistics, Mathematics, Data Science, Engineering or related discipline
  • Microsoft Azure certification (good to have)

    M&G Behaviours relevant to all roles :

    Inspire Others : support and encourage each other, creating an environment where everyone can contribute and succeed

    Embrace Change : be open to change, willing to be challenged and able to adapt quickly and imaginatively to new ideas

    Deliver Results : focus on performance, set high standards and deliver with energy and determination

    Keep it simple : cut through complexity, keep the outcome in mind, keeping your approach simple and adapting your message to every audience

    We have a diverse workforce and an inclusive culture at M&G Global Services, regardless of gender, ethnicity, age, sexual orientation, nationality, disability or long term condition, we are looking to attract, promote and retain exceptional people. We also welcome those who take part in military service and those returning from career breaks.

    Skills Required

    Pyspark, Azure Data Factory, Power Bi, Azure Databricks, Azure Logic Apps, Azure Sql, Azure Devops

    Create a job alert for this search

    Lead Data Engineer • Mumbai, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    RecroThane, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Philodesign Technologies Incthane, maharashtra, in
    The ideal candidate will have strong hands-on expertise in.Azure Data Factory (ADF), Synapse, and Databricks.ETL, SQL, and data warehousing concepts. Design, develop, and implement ETL solutions usi...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Guidanz Incmumbai, maharashtra, in
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    StraiveMumbai, Maharashtra, India
    Data Engineer will be responsible for designing, developing, and maintaining data pipelines and architectures that support the organization's analytics and reporting needs.The ideal candidate will ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    AWS Lead Data engineer

    AWS Lead Data engineer

    Tata Consultancy Servicesthane, maharashtra, in
    In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show moreLast updated: 10 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    FornaxMumbai, Mumbai (district)
    If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 1 day ago
    • Promoted
    Reveille Technologies - Big Data Engineer

    Reveille Technologies - Big Data Engineer

    Reveille TechnologiesMumbai
    Description : We are looking for highly skilled and motivated Big Data Engineers / Leads to join our team and drive the development of our next-generation data plat...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    Fornaxmumbai, maharashtra, in
    If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Lead Data Engineer [T500-21309]

    Lead Data Engineer [T500-21309]

    ANSRthane, maharashtra, in
    ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show moreLast updated: 11 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsmumbai city, maharashtra, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgethane, maharashtra, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalMumbai, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeThane, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data & Analytics Engineer

    Data & Analytics Engineer

    APPIT Software IncMumbai, IN
    Data Engineer : Snowflake -Mandatory – Hands -on Experience.ETL Tool -Informatica [IVS version],BDT.GCP : Big query – Mandatory -handson experience. Data Modelling & Data Warehouse -Mandatory -Hands...Show moreLast updated: 14 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpressnavi mumbai, maharashtra, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneKalyan-Dombivli, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Nile Connect LLPmumbai city, maharashtra, in
    We’re Hiring : Data Engineer (5–9 Years Experience).Are you a passionate Data Engineer ready to work with cutting-edge technologies and high-performing teams? We’re looking for an energetic, self-mo...Show moreLast updated: 11 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Datacore Technologiesthane, maharashtra, in
    Primary Skills Azure Data factory (PipelinesData flows),AzureDataLake-Gen2Storage,Logic Apps,SQL Server Analysis Services(Tabular),Power BI(Dataset Creation only),DAX,T-SQL (Stored procedure, views...Show moreLast updated: 15 days ago