AI Performance Modeling Specialist

About TalentGum

TalentGum is transforming extracurricular learning for children aged 5–14 years through engaging live online courses in music, dance, chess, and public speaking etc.

Our mission is to build the next generation of learning intelligence — an AI-driven platform that can observe, understand, and help children improve their creative and cognitive skills through personalized, real-time insights.

We are looking for AI Research Engineers who are passionate about bridging human creativity and machine intelligence, and want to work at the intersection of AI, performance, and education.

Role Overview

As an AI Research Engineer , you’ll design and develop machine learning systems that can understand and evaluate human performance — starting with sound (music, speech) and later expanding to vision (movement, gestures).

You’ll collaborate with Audio / Vision Engineers , Backend Developers , and Subject Matter Experts (SMEs) such as musicians, dancers, and coaches to convert expert intuition into measurable, scalable AI feedback.

Key Responsibilities

• Research, design, and train AI models for real-time performance evaluation across domains (music first, then dance / speech / chess).
• Implement and optimize deep learning architectures for audio and / or visual understanding (CNNs, RNNs, Transformers).
• Work closely with Audio / Vision Engineers to build data pipelines for clean, real-time feature extraction (spectrograms, keypoints, pose sequences).
• Collaborate with SMEs to define “performance quality” metrics and label datasets.
• Develop evaluation frameworks to quantify model accuracy vs. expert feedback.
• Experiment with cross-modal fusion (audio + vision) for synchronized analysis in future domains like dance.
• Optimize models for low-latency inference on web / mobile devices (ONNX, TensorRT, TF Lite).
• Document research findings, prototype outcomes, and contribute to internal knowledge-sharing.

Required Skills & Experience

o Pitch detection, beat tracking, timbre classification, speech analysis,

o Pose estimation, gesture recognition, or motion tracking.

Nice to Have

What You’ll Achieve

Why Join Us