Talent.com
Data Engineer Lead

Data Engineer Lead

ConfidentialPune, India
4 days ago
Job description

Metro Global Solution Center (MGSC) is internal solution partner for METRO, a €31.6 Billion international wholesaler with operations in 32 countries through 625 stores & a team of 85,000 people globally. Metro operates in a further 10 countries with its Food Service Distribution (FSD) business and it is thus active in a total of 34 countries.

MGSC, location wise is present in Pune (India), Düsseldorf (Germany) and Szczecin (Poland). We provide HR, Finance, Branding, IT & Business operations support to 31 countries, speak 24+ languages and process over 18,000 transactions a day. We are setting tomorrow's standards for customer focus, digital solutions, and sustainable business models. For over 10 years, we have been providing services and solutions from our two locations in Pune and Szczecin. This has allowed us to gain extensive experience in how we can best serve our internal customers with high quality and passion. We believe that we can add value, drive efficiency, and satisfy our customers.

Website : https : / / www.metro-gsc.in

Company Size : 950-1000

Headquarters : Pune, Maharashtra, India

Type : Privately Held

Inception : 2011

Job Description

Key Responsibilities

  • Take ownership of the technical direction and execution of machine learning projects within the Data Science team;
  • Mentor and support junior engineers and data scientists, enabling their growth and success;
  • Establish best practices for software design, architecture, and MLOps;
  • Design and optimize end-to-end machine learning pipelines for training, testing, and deployment in production environments;
  • Ensure seamless deployment of machine learning models and implement monitoring solutions to track performance, accuracy, and drift over time;
  • Collaborate with data scientists to transition experimental models to production-grade solutions;
  • Work closely with other software / data engineers and product teams to ensure effective delivery of machine learning products;
  • Collaborate with other teams and gather requirements to solve complex customer problems with machine learning;
  • Maintain and scale machine learning infrastructure using GCP;
  • Implement robust security measures to protect data privacy;
  • Create and maintain APIs or other interfaces to deliver machine learning results to internal teams and Metro's customers;
  • Evaluate emerging machine learning technologies, frameworks, and trends, and introduce improvements to existing workflows.

Qualifications

Education

Bachelor's or Master's degree in Computer Science, Software Engineering, or equivalent practical experience.

Work Experience & Skills

  • 8 years of hands-on experience in building and deploying machine learning models in production. Strong technical background and current modern BI and reporting technologies;
  • Proven experience in leading or mentoring technical teams;
  • Proficiency in Python, Go and machine learning frameworks;
  • Strong understanding of MLOps tools and practices, including CI / CD pipelines, model versioning, and monitoring;
  • Proficient with data transformation tools (preferable dbt);
  • Expertise in GCP services such a Cloud Run, Kubernetes, BigQuery and VertexAI;
  • Solid skills in API development and automated testing;
  • Exceptional problem-solving abilities and a proactive, team-oriented mindset;
  • Strong communication and collaboration skills, with the ability to explain technical concepts to non-technical stakeholders;
  • Leadership qualities with a track record of driving projects and guiding teams toward success;
  • Experience in optimizing models for performance (e.g., inference speed, resource usage);
  • Additional Information

    Nice-to-Have

    Understanding of ethical AI, bias mitigation, and data privacy principles.

    Skills Required

    BigQuery, Api Development, Go, Automated Testing, Monitoring, dbt, Kubernetes, Python

    Create a job alert for this search

    Lead Data Engineer • Pune, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    RecroPune, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionPune, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 12 days ago
    • Promoted
    Lead Data Engineer (databricks)

    Lead Data Engineer (databricks)

    Mayur Chhatbar (Proprietor Of KD Servicess)Ahmedabad, Pune
    We are looking for an accomplished Lead Data Engineer with expertise in Databricks to join our dynamic team.This role is crucial for enhancing our data engineering capabilities, and it offers the c...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer (Azure, Databricks architecture, 8+yrs)

    Lead Data Engineer (Azure, Databricks architecture, 8+yrs)

    Innova ESIpune, maharashtra, in
    Drive end to end integration delivery through analysis, design, build and deployment.Manage requirement gathering and analysis necessary for integration build. Develop new and enhanced integrations ...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHpune, maharashtra, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer (Databricks)

    Lead Data Engineer (Databricks)

    ConfidentialPune, India
    Founded in 2016, we pride ourselves on fostering an environment where creativity flourishes, bureaucracy is non-existent, and individuals are encouraged to challenge the status quo.We're not just a...Show moreLast updated: 4 days ago
    • Promoted
    Manager, Data Engineer

    Manager, Data Engineer

    MastercardPune, Maharashtra, India
    Title and Summary Manager, Data Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow Who is Mastercard? Mastercard is a global technology company in the payments indus...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Calfus Inc.pune, maharashtra, in
    As a Data Engineer – BI Analytics & DWH, you will play a pivotal role in designing and implementing comprehensive business intelligence solutions that empower our organization to make data-driven d...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Innova Solutionspune, maharashtra, in
    We're Hiring : Lead Data Consultant / Senior Data Engineer.Industry : Financial Services & Insurance (FSI).Are you passionate about building scalable, cloud-native data platforms? Join our team to le...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzonePune, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Solytics Partnerspune, maharashtra, in
    Solytics Partners is a Global Analytics firm, recognized with multiple industry awards for innovation and excellence.Our team comprises experts with deep knowledge in risk, analytics, AI / ML, AML / FC...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    InfarsightPune, Maharashtra, India
    At Infarsight, we simplify complex operations across Finance, HR, Operations, and Supply Chain using platforms like Task Sight, Trip Sight, and Fleet Sight. Our engineering teams build scalable soft...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalPune, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer Lead

    Data Engineer Lead

    CoffeeBeansPune, Maharashtra, India
    Hybrid (3 days WFO, 2 days WFH).Tech-lead in one of the feature teams, candidate need to be work along with team lead in handling the team without much guidance. Good communication and leadership sk...Show moreLast updated: 29 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpresspune, maharashtra, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 1 day ago
    • Promoted
    Lead Big Data Engineer - Spark

    Lead Big Data Engineer - Spark

    QUALYS SECURITY TECHSERVICES PRIVATE LIMITEDPune
    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!.Description : We are seeking a talented Lead Big ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgepune, maharashtra, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    XANDER CONSULTING AND ADVISORY PRIVATE LIMITEDPune
    Description : - Design, develop, and maintain scalable data pipelines using Azure Databricks, Apache Spark, and Delta Lake. Implement data ingestion, transformation, ...Show moreLast updated: 9 days ago