01641nas a2200109 4500008004100000245006800041210006700109260001400176520128500190100002001475856003601495 2013 eng d00aContext-Aware Gesture Recognition in Classical Music Conducting0 aContextAware Gesture Recognition in Classical Music Conducting aBarcelona3 a
Body movement has received increasing attention in music technology research during the last years. Some new mu- sical interfaces make use of gestures to control music in a meaningful and intuitive way. A typical approach is to use the orchestra conducting paradigm, in which the computer that generates the music would be a virtual orchestra con- ducted by the user. However, although conductors’ gestures are complex and their meaning can vary depending on the musical context, this context-dependency is still to explore. We propose a method to study context-dependency of body and facial gestures of conductors in orchestral classical mu- sic based on temporal clustering of gestures into actions, followed by an analysis of the evolution of audio features after action occurrences. For this, multi-modal data (audio, video, motion capture) will be recorded in real live concerts and rehearsals situations using unobtrusive techniques.
1 aSarasua, Alvaro uhttp://phenicx.upf.edu/node/112