01236nas a2200133 4500008004100000245006700041210006600108260003400174520079400208100002501002700002101027700001901048856003501067 2013 eng d00aLooking Beyond Sound: Unsupervised Analysis of Musician Videos0 aLooking Beyond Sound Unsupervised Analysis of Musician Videos a Paris, FrancebIEEEc07/20133 a
In this work, we focus on visual information conveyed by performing musicians. While musicians are playing, their movement relates to their musical performance. As such, analysis of this information can support structural characterization and timeline indexing of a recorded performance, especially in cases when such analyses are not trivially computed from the musical audio. We propose an unsupervised visual analysis method, in which visual novelty is inferred from motion orientation histograms of regions of interest. Considering our method in a case study on audiovisually recorded jam sessions, we show that our analysis of the visual channel yields promising and meaningful performance-related information, including information complementary to the audio channel.
1 aLiem, Cynthia, C. S.1 aBazzica, Alessio1 aHanjalic, Alan uhttp://phenicx.upf.edu/node/97