[HTML][HTML] A cross-species framework for classifying sound-movement couplings

S Leonetti, A Ravignani, W Pouw - Neuroscience & Biobehavioral Reviews, 2024 - Elsevier
Sound and movement are entangled in animal communication. This is obviously true in the
case of sound-constituting vibratory movements of biological structures which generate …

Hindustani raga and singer classification using 2D and 3D pose estimation from video recordings

M Clayton, J Li, A Clarke… - Journal of New Music …, 2024 - Taylor & Francis
Using pose estimation with video recordings, we apply an action recognition machine
learning algorithm to demonstrate the use of the movement information to classify singers …

Leg movements affect speech intensity

H Serré, M Dohen, S Fuchs, S Gerber… - Journal of …, 2022 - journals.physiology.org
Coordination between speech acoustics and manual gestures has been conceived as “not
biologically mandated”(McClave E. J Psycholinguist Res 27 (1): 69–89, 1998). However …

Body motion of choral singers

S D'Amario, S Ternström, W Goebl, L Bishop - Frontiers in Psychology, 2023 - frontiersin.org
Recent investigations on music performances have shown the relevance of singers' body
motion for pedagogical as well as performance purposes. However, little is known about …

[PDF][PDF] Exploring the Correspondence of Melodic Contour With Gesture in Raga Alap Singing.

S Nadkarni, S Roychowdhury, P Rao, M Clayton - ISMIR, 2023 - ee.iitb.ac.in
Musicology research suggests a correspondence between manual gesture and melodic
contour in raga performance. Computational tools such as pose estimation from video and …

The human voice aligns with whole-body kinetics

W Pouw, W Raphael, LS Burchardt, LPJ Selen - bioRxiv, 2023 - biorxiv.org
Humans use their voice concurrently with upper limb movements, known as hand gestures.
Recently it has been shown that fluctuations in intensity and the tone of the human voice …

Multimodal Embodiment Research of Oral Music Traditions: Electromyography in Oud Performance and Education Research of Persian Art Music

S Paschalidou - Multimodal Technologies and Interaction, 2024 - mdpi.com
With the recent advent of research focusing on the body's significance in music, the
integration of physiological sensors in the context of empirical methodologies for music has …

[PDF][PDF] Landscapes of coarticulation: The co-structuring of gesture-vocal dynamics in Karnatak vocal performance

L Pearson, T Nuttall, W Pouw - 2024 - osf.io
In vocal performance contexts, vocalists tend to gesture in ways that show both similarities
and idiosyncrasies. We present a quantitative analyses and visualisation pipeline that …

Effort in Hindustani Dhrupad Singing: Using Interviews to Develop Effort Inference Models of Acoustic and Movement Features

S Paschalidou - Yearbook for Traditional Music, 2024 - cambridge.org
This article sets out the results of research into effort in Dhrupad, a genre of Hindustani
music. I examine gestural interactions with imaginary objects that vocalists outline when …

Gesture–speech coupling in persons with aphasia: A kinematic-acoustic analysis.

T Jenkins, W Pouw - Journal of Experimental Psychology: General, 2023 - psycnet.apa.org
Aphasia is a profound language pathology hampering speech production and/or
comprehension. People With Aphasia (PWA) use more manual gestures than Non-Brain …