Scurto et al., 2015—2017
cognitive psychology, music
A cognitive psychology experiment on sound embodiment with gestures and vocalizations. We first led qualitative annotation of an audio-visual database of gestural and vocal imitations of sounds to establish a set of hypotheses. We then designed a controlled experiment and performed quantitative analysis of motion and sound data harvested. The study suggests that people embody sounds using gestures that metaphorically express one salient feature of sound, along with vocalizations that attempt to reproduce all sound features as faithfully as humanly possible.