Talent.com
Data Engineer Lead
Data Engineer LeadMETRO/MAKRO • Pune, Maharashtra, India
Data Engineer Lead

Data Engineer Lead

METRO / MAKRO • Pune, Maharashtra, India
30+ days ago
Job description

Key Responsibilities

  • Take ownership of the technical direction and execution of machine learning projects within the Data Science team;
  • Mentor and support junior engineers and data scientists enabling their growth and success;
  • Establish best practices for software design architecture and MLOps;
  • Design and optimize end-to-end machine learning pipelines for training testing and deployment in production environments;
  • Ensure seamless deployment of machine learning models and implement monitoring solutions to track performance accuracy and drift over time;
  • Collaborate with data scientists to transition experimental models to production-grade solutions;
  • Work closely with other software / data engineers and product teams to ensure effective delivery of machine learning products;
  • Collaborate with other teams and gather requirements to solve complex customer problems with machine learning;
  • Maintain and scale machine learning infrastructure using GCP;
  • Implement robust security measures to protect data privacy;
  • Create and maintain APIs or other interfaces to deliver machine learning results to internal teams and Metros customers;
  • Evaluate emerging machine learning technologies frameworks and trends and introduce improvements to existing workflows.

Qualifications : Education

Bachelors or Masters degree in Computer Science Software Engineering or equivalent practical experience.

Work Experience & Skills

  • 8 years of hands-on experience in building and deploying machine learning models in production. Strong technical background and current modern BI and reporting technologies;
  • Proven experience in leading or mentoring technical teams;
  • Proficiency in Python Go and machine learning frameworks;
  • Strong understanding of MLOps tools and practices including CI / CD pipelines model versioning and monitoring;
  • Proficient with data transformation tools (preferable dbt);
  • Expertise in GCP services such a Cloud Run Kubernetes BigQuery and VertexAI;
  • Solid skills in API development and automated testing;
  • Exceptional problem-solving abilities and a proactive team-oriented mindset;
  • Strong communication and collaboration skills with the ability to explain technical concepts to non-technical stakeholders;
  • Leadership qualities with a track record of driving projects and guiding teams toward success;
  • Experience in optimizing models for performance (e.g. inference speed resource usage);
  • Additional Information :

    Nice-to-Have

    Understanding of ethical AI bias mitigation and data privacy principles.

    Remote Work : No

    Employment Type : Full-time

    Key Skills

    Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

    Experience : years

    Vacancy : 1

    Create a job alert for this search

    Lead Data Engineer • Pune, Maharashtra, India

    Related jobs
    Data Engineer

    Data Engineer

    Recro • Pune, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITC Infotech • Pune, Maharashtra, India
    Location : Banglore / Pune (Hybrid).This role is critical to building a robust data foundation for training thousands of AI models that detect anomalous behavior across applications, services, and fun...Show more
    Last updated: 11 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Confidential • Pune, India
    Mastercard powers economies and empowers people in 200+ countries and territories worldwide.Together with our customers, we're helping build a sustainable economy where everyone can prosper.We supp...Show more
    Last updated: 30+ days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Pune, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 8 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snowflake, drive perf...Show more
    Last updated: 10 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    INDI Staffing Services • Pune, IN
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show more
    Last updated: 22 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Corporate Steps • Pune
    Description : This role is for a highly skilled and experienced Data Pipeline Architect / Lead Engineer responsible for setting the technical direction and leading the...Show more
    Last updated: 2 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce Inc • Pune, Maharashtra, India
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show more
    Last updated: 29 days ago • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Confidential • Pune, India
    Hybrid (3 days WFO, 2 days WFH).Tech-lead in one of the feature teams, candidate need to be work along with team lead in handling the team without much guidance. Good communication and leadership sk...Show more
    Last updated: 26 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Pune, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Pune, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Tech Lead

    Data Engineer - Tech Lead

    ACL Digital • pune, maharashtra, in
    We are looking for professionals with expertise in Data Engineering.Data Engineer - Looking for 6+years experience -Tech Lead – Data Engineer - looking for 10+ years of experience.If this role matc...Show more
    Last updated: 10 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Saras Analytics • pune, maharashtra, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show more
    Last updated: 17 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpress • pune, maharashtra, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show more
    Last updated: 22 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    EXL • pune, maharashtra, in
    We are seeking a highly skilled.The ideal candidate will bring deep technical expertise, strong leadership, and the ability to collaborate effectively with global stakeholders in a fast-paced envir...Show more
    Last updated: 7 days ago • Promoted
    Lead Data Analytics Engineer

    Lead Data Analytics Engineer

    Confidential • Pune, India
    ICE Data Services (an Intercontinental Exchange company) is seeking strong candidates to join its Spatial Intelligence team. This hire will be an immediate contributor to an ambitious roadmap in US ...Show more
    Last updated: 8 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Bajaj Technology Services • Pune, Maharashtra, India
    Domain : eCommerce / Financial Reconciliation.Data Engineer own and operate a large-scale data processing and reconciliation platform for an eCommerce enterprise. The role involves execution, support...Show more
    Last updated: 1 day ago • Promoted
    Azure Data Lead Engineer

    Azure Data Lead Engineer

    Persistent Systems • Pune, Maharashtra, India
    We are looking for Lead Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team. Role : Azure Data Lead Engineer.Job Type : Full Time Employment.Design...Show more
    Last updated: 7 days ago • Promoted