[PDF][PDF] Landscapes of coarticulation: The co-structuring of gesture-vocal dynamics in Karnatak vocal performance

L Pearson, T Nuttall, W Pouw - 2024 - osf.io
2024osf.io
In vocal performance contexts, vocalists tend to gesture in ways that show both similarities
and idiosyncrasies. We present a quantitative analyses and visualisation pipeline that
characterises the multidimensional codependencies of spontaneous body movements and
vocalisations in vocal performers. We apply this pipeline to a dataset of performances within
the Karnatak music tradition of South India, including audio and motion tracking data, which
we openly publish with this report. Our results show that the time-varying features of head …
Abstract
In vocal performance contexts, vocalists tend to gesture in ways that show both similarities and idiosyncrasies. We present a quantitative analyses and visualisation pipeline that characterises the multidimensional codependencies of spontaneous body movements and vocalisations in vocal performers. We apply this pipeline to a dataset of performances within the Karnatak music tradition of South India, including audio and motion tracking data, which we openly publish with this report. Our results show that the time-varying features of head and hand gestures tend to be more similar when the concurrent vocal time-varying features are also more similar. While for each performer we find clear co-structuring of sound and movement, they each show their own characteristic salient dimensions (eg, hand position, head acceleration) on which movement is coarticulated with singing. Our analyses thereby provide a computational characterisation of the unique multimodal coarticulations with singing for each performer. The results support our conceptual contribution of widening the conception of coarticulation, from within a ‘modality’(eg, speech articulator positions, joint angles in reaching), to a multimodal coarticulation constrained by both physiological and aesthetic ‘control parameters’ that reduce degrees of freedom of the multimodal performance such that motifs that sound alike tend to co-structure with gestures that move alike.
osf.io
以上显示的是最相近的搜索结果。 查看全部搜索结果

Google学术搜索按钮

example.edu/paper.pdf
搜索
获取 PDF 文件
引用
References