Talent.com
This job offer is not available in your country.
EY - GDS Consulting - AI And DATA - Data Engineering Manager

EY - GDS Consulting - AI And DATA - Data Engineering Manager

EYPune, Maharashtra, India
15 hours ago
Job description

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.

Objectives and Purpose

  • The Data Engineering Manager leads large scale solution architecture design and optimisation to provide streamlined insights to partners throughout the business. This individual leads the team of Mid and Senior data engineers to partner with visualization on data quality and troubleshooting needs.
  • The Data Engineering manager will : Implement data processes for the data warehouse and internal systems Lead a team of Junior and Senior Data Engineers in executing data processes and providing quality, timely data management Managing data architecture, designing ETL process Clean, aggregate and organize data from disparate sources and transfer it to data warehouses. Lead development testing and maintenance of data pipelines and platforms, to enable data quality to be utilized within business dashboards and tools. Support team members and direct reports in refining and validating data sets. Ensure we follow all the enterprise data management and principles. Understanding data management best practices Create, maintain, and support the data platform and infrastructure that enables the analytics front-end; this includes the testing, maintenance, construction, and development of architectures such as high-volume, large-scale data processing and databases with proper verification and validation processes. Enterprise data governance principles - All the projects that are coming are following the process. Data catalogue, data security, access policy control, data lineage, new data domains Understanding of data domains - Pharma commercials, medical affairs, sales and marketing, patient services

Your key responsibilities

  • Lead the design, development, optimization, and maintenance of data architecture and pipelines adhering to ETL principles and business goals.
  • Develop and maintain scalable data pipelines, build out new integrations using AWS native technologies and data bricks to support increases in data source, volume, and complexity.
  • Define data requirements, gather and mine large scale of structured and unstructured data, and validate data by running various data tools in the Big Data Environment.
  • Lead the ad hoc data analysis, support standardization, customization and develop the mechanisms to ingest, analyze, validate, normalize, and clean data.
  • Write unit / integration / performance test scripts and perform data analysis required to troubleshoot data related issues.
  • Implement processes and systems to drive data reconciliation and monitor data quality, ensuring production data is always accurate and available for key stakeholders, downstream systems, and business processes.
  • Lead the evaluation, implementation and deployment of emerging tools and processes for analytic data engineering to improve productivity.
  • Develop and deliver communication and education plans on analytic data engineering capabilities, standards, and processes.
  • Solve complex data problems to deliver insights that help achieve business objectives.
  • Partner with Business Analysts and Enterprise Architects to develop technical architectures for strategic enterprise projects and initiatives.
  • Coordinate with Data Scientists, visualization developers and other data consumers to understand data requirements, and design solutions that enable advanced analytics, machine learning, and predictive modelling.
  • Collaborate with AI / ML engineers to create data products for analytics and data scientist team members to improve productivity.
  • Advise, consult, mentor and coach other data and analytic professionals on data standards and practices, promoting the values of learning and growth.
  • Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
  • To qualify for the role, you must have the following :

    Preferred Skillsets

  • Bachelor's degree in Engineering, Computer Science, Data Science, or related field
  • 10+ years of experience in software development, data engineering, ETL, and analytics reporting development.
  • Expert in building and maintaining data and system integrations using dimensional data modelling and optimized ETL pipelines.
  • Advanced experience utilizing modern data architecture and frameworks like data mesh, data fabric, data product design
  • Experience with designing data integration frameworks capable of supporting multiple data sources, consisting of both structured and unstructured data
  • Proven track record of designing and implementing complex data solutions
  • Demonstrated understanding and experience using : Data Engineering Programming Languages (, Python, SQL) Distributed Data Framework (, Spark) Cloud platform services (AWS / Azure) Relational Databases Working knowledge of DevOps (Github / Gitlab etc.) with continuous integration AWS knowledge on services like Lambda, DMS, Step Functions, S3, Event Bridge, Cloud Watch, Aurora RDS or related AWS ETL services Data ingestion patterns. Ability to recommend right tools for data ingestion. The individual will also have to collaborate with enterprise architect Knowledge of Data lakes, Data warehouses Databricks / Delta Lakehouse architecture
  • Deep understanding of database architecture, Data modelling concepts and administration.
  • Handson experience of Spark Structured Streaming for building real-time ETL pipelines.
  • Proficient in programming languages (, SQL, Python, Pyspark) to design, develop, maintain, and optimize data architecture / pipelines that fit business goals.
  • Extracts, transforms, and loads data from multiple external / internal sources using Databricks Lakehouse / Data Lake concepts into a single, consistent source to serve business users and data visualization needs.
  • Leverages continuous integration and delivery principles to automate code deployment to elevated environments using GitHub Actions.
  • Excellent written and verbal communication skills, including storytelling and interacting effectively with multifunctional teams and other strategic partners.
  • Strong organizational skills with the ability to manage multiple projects simultaneously, operating as leading member across globally distributed teams.
  • Strong problem solving and troubleshooting skills.
  • Lead and oversee the code review process within the data engineering team to ensure high-quality, efficient, and maintainable code, while optimizing for performance and scalability.
  • Ability to work in a fast-paced environment and adapt to changing business priorities.
  • Identifying and implementing strategies to optimize AWS / Databricks cloud costs, ensuring efficient and cost-effective use of cloud resources.
  • Hand on experience on Cloud AWS / Azure, Spark. Individual should be open to upskilling, Snowflake (must), Redshift, Postrgres, Spark architecture.
  • Good to have skillsets

  • Master's degree in engineering specialized in Computer Science, Data Science, or related field
  • Experience working with pharma clients, preferably in commercial pharma, marketing and medical affairs
  • Understanding of Databricks Unity Catalog for effective data governance and implementing robust access control mechanisms is highly advantageous.
  • Demonstrated understanding and experience using : Knowledge in CDK Job orchestration tools like Tidal / Airflow / or similar
  • Knowledge on No SQL
  • Experience in a global working environment
  • Databricks Certified Data Engineer Professional
  • AWS Certified Data Engineer - Associate
  • EY | Building a better working world

    Create a job alert for this search

    Ey Consulting Ai And • Pune, Maharashtra, India

    Related jobs
    • Promoted
    • New!
    Senior Development Manager - Full stack AI Product Engineering Openings At Wolters Kluwer Pune and Chennai

    Senior Development Manager - Full stack AI Product Engineering Openings At Wolters Kluwer Pune and Chennai

    Wolters KluwerKalyani Nagar, Maharashtra, India
    Senior Manager Product Software Engineering – UI / Gen AI.This position requires a passionate and technology driven candidate to be responsible to manage UI and AI Product Engineering teams and respo...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Associate Director, Data Engineering - India

    Associate Director, Data Engineering - India

    Cornerstone OnDemandPune, Maharashtra, India
    Associate Director, Data Engineering - India.Associate Director Data Engineering.Associate Director, Data Engineering.Data & Analytics team, responsible for the development and delivery of scalable...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    S&C GN - Data&AI - CMT Eng - Associate Manager

    S&C GN - Data&AI - CMT Eng - Associate Manager

    AccentureHadapsar, Maharashtra, India
    Job Title - S&C Global Network - AI - CMT –ML Ops – Ass Manager.Management Level : 8- Associate Manager.Ability to leverage design thinking, business process optimization, and stakeholder management...Show moreLast updated: 15 hours ago
    • Promoted
    Data Engineering Azure databricks

    Data Engineering Azure databricks

    EXLPune, IN
    Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Work with stakeholders to unders...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Director : Data and AI lead

    Director : Data and AI lead

    Deutsche BankPune, Maharashtra, India
    Corporate Banking is a technology centric business, with an increasing move to real-time processing, an increasing appetite from customers for integrated systems and access to supporting data.This ...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Manager, Data Scientist (CEE Business Intelligence)

    Manager, Data Scientist (CEE Business Intelligence)

    Red Hat, Inc.Pashan, Maharashtra, India
    The Business Intelligent division of GSS (Global Support Services) team is seeking a Manager - Technical Support to join us in Pune, India. The GSS team is Red Hat's customer-facing support organiza...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Lead Data Engineer - Data Engineering

    Lead Data Engineer - Data Engineering

    CencoraPune, Maharashtra, India
    Our team members are at the heart of everything we do.At Cencora, we are united in our responsibility to create healthier futures, and every person here is essential to us being able to deliver on ...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Deputy Manager _ GCP Data Engineer - BI

    Deputy Manager _ GCP Data Engineer - BI

    VodafonePune, Maharashtra, India
    VOIS (Vodafone Intelligent Solutions) is a strategic arm of Vodafone Group Plc, creating value and enhancing quality and efficiency across 28 countries, and operating from 7 locations : Albania, Egy...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Lead Consultant - Data Engineer AWS+ Python

    Lead Consultant - Data Engineer AWS+ Python

    GenpactPune, Maharashtra, India
    Genpact (NYSE : G) is a global professional services and solutions firm delivering outcomes that shape the future.Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepr...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Saaki Argus & Averil ConsultingPune, Maharashtra, India
    Hiring Senior Data Engineer for an IT Product Company.Minimum 4+Yrs of Relevant Experience.Mandatory Skills : Strong expertise in Python ( Class methods), OOPS in Python, SQL , Databricks , AWS or A...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    IN_Manager_ AI Engineer_Data and Analytics_Advisory_Pune

    IN_Manager_ AI Engineer_Data and Analytics_Advisory_Pune

    PwCPune, Maharashtra, India
    Summary : We are seeking an experienced • •AI Engineer • • with a minimum of 4 years of experience in developing machine learning models and at least 3 years of experience deploying AI solutions into p...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Manager_Lead_Data Engineer_Pune

    Manager_Lead_Data Engineer_Pune

    VodafonePune, Maharashtra, India
    Key accountabilities and decision ownership .Prepare LLD in accordance with HLD by Architect of the project.Build and Operationalize data processing system as per Low level design.Understanding and...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Lead Consultant - Data Engineer AWS + Python

    Lead Consultant - Data Engineer AWS + Python

    GenpactPune, Maharashtra, India
    Genpact (NYSE : G) is a global professional services and solutions firm delivering outcomes that shape the future.Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepr...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Data Engineer III - Data Engineering

    Data Engineer III - Data Engineering

    CencoraPune, Maharashtra, India
    Bachelor’s degree in Computer Science, Information Technology or any other related discipline or equivalent related experience. Data Management / Engineering Certifications in MS Azure, Databricks etc...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Data Science+Gen ai-Con / Sn.Con / Man / AD

    Data Science+Gen ai-Con / Sn.Con / Man / AD

    Talent WorxPune, Maharashtra, India
    Work with business stakeholders and cross-functional SMEs to deeply understand business context and key business questions . Create Proof of concepts (POCs) / Minimum Viable Products (MVPs), then gu...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Ab Initio Data Engineers

    Ab Initio Data Engineers

    ExusiaPune, Maharashtra, India
    Exusia, a cutting-edge digital transformation consultancy, is looking for top talent in the Data Engineering space with specific skills in Ab Initio / Azure Data Engineering services to join our gl...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Manager - Data Architect - Pune

    Manager - Data Architect - Pune

    VodafonePune, Maharashtra, India
    We are seeking a skilled Data Architect to lead the delivery of data management solutions and drive transformation initiatives across Group and Local Markets. This role involves transitioning from l...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Director : AI Tech Lead

    Director : AI Tech Lead

    Deutsche BankHadapsar, Maharashtra, India
    Job Title : Director : AI Tech Lead.We are seeking an experienced AI Technology Lead to lead our Artificial Intelligence(AI) strategy, development, and implementation across the function.The successf...Show moreLast updated: 15 hours ago