Research‎ > ‎

Choreographing Amateur Performers Based on Motion Transfer between Videos


Home        Research        Publications



Choreographing Amateur Performers Based on Motion Transfer between Videos


Kenta Mizui
Makoto Okabe Rikio Onai
The University of Electro-Communications The University of Electro-Communications / JST PRESTO The University of Electro-Communications

a

Our method uses a pair of videos of a physical activity, such as a karate kick, as input; one is the target video of an amateur performance (a), and the other is a video of a corresponding professional performance (b). We extract timing and pose information from the professional performance and use it to choreograph the amateur performance (c). 


 Abstract

We propose a technique for quickly and easily choreograph- ing a video of an amateur performer by comparing it with a video of a corresponding professional performance. Our method allows the user to interactively edit the amateur performance in order to synchronize it with the professional performance in terms of timings and poses. In our system, the user first extracts the amateur and professional poses from every frame via semi-automatic video tracking. The system synchronizes the timings by computing dynamic time warping (DTW) between the two sets of video-tracking data, and then synchronizes the poses by ap- plying image deformation to every frame. To eliminate unnatural vibra- tions, which often result from inaccurate video tracking, we apply an automatic motion-smoothing algorithm to the synthesized animation. We demonstrate that our method allows the user to successfully edit an amateur’s performance into a more polished one, utilizing the Japanese sumo wrestling squat, the karate kick, and the moonwalk as examples. 


 Paper

  • In Proc. of MMM 2013. [PDF]
      


 Video & Poster



 Reference

  • Kenta Mizui, Makoto Okabe, Rikio Onai"Choreographing Amateur Performers Based on Motion Transfer between Videos", In Proc. of MMM 2013. 
Ċ
水井健太,
2013/02/24 6:04
č
MMMvideo.mp4
(10568k)
水井健太,
2013/02/24 6:07
Ċ
水井健太,
2013/02/24 5:50
Comments