Action and Music

1. A Deep Music Recommendation Method based on Human Motion Analysis

Description:

Despite its applications in automatic video editing and automatic music composition, the problem of music recommendation from dance motions has seldom been explored. In order to solve this problem, this work proposes a deep music recommendation algorithm based on dance motion analysis and evaluate it through quantitative measures. For quantitative evaluation, this work implements a LSTM-AE based music recommendation method which learns the correspondences between motion and music. In experiments, the two methodologies are compared and the motion analysis based methods outperform their rival by large margins. This work also proposes a quantitative measure of accurately recommended music genre. The proposed motion analysis based method achieves a recommendation accuracy of 91.3% using late fusion of joint and limb features.

Paper

Code and Experiments Available (GitHub)

Recommendation Results: (Dancing Motion with Groundtruth/Recommended Background Music)

** Category 1. Cha-cha **

Test 1-Grounth Truth

Test 1-Recommendation 1

Test 1-Recommendation 2

Test 1-Recommendation 3

Test 2-Ground Truth

Test 2-Recommendation 1

Test 2-Recommendation 2

Test 2-Recommendation 3

Test 3-Ground Truth

Test 3-Recommendation 1

Test 3-Recommendation 2

Test 3-Recommendation 3

** Category 2. Rumba **

Test 1-Grounth Truth

Test 1-Recommendation 1

Test 1-Recommendation 2

Test 1-Recommendation 3

Test 2-Grounth Truth

Test 2-Recommendation 1

Test 2-Recommendation 2

Test 2-Recommendation 3

Test 3-Ground Truth

Test 3-Recommendation 1

Test 3-Recommendation 2

Test 3-Recommendation 3

** Category 3. Tango **

Test 1-Grounth Truth

Test 1-Recommendation 1

Test 1-Recommendation 2

Test 1-Recommendation 3

Test 2-Grounth Truth

Test 2-Recommendation 1

Test 2-Recommendation 2

Test 2-Recommendation 3

** Category 4. Waltz **

Test 1-Grounth Truth

Test 1-Recommendation 1

Test 1-Recommendation 2

Test 1-Recommendation 3

Test 2-Grounth Truth

Test 2-Recommendation 1

Test 2-Recommendation 2

Test 2-Recommendation 3

Test 3-Ground Truth

Test 3-Recommendation 1

Test 3-Recommendation 2

Test 3-Recommendation 3

Page updated

Google Sites

Report abuse