Is multimedia multisensorial?-a review of mulsemedia systems

A Covaci, L Zou, I Tal, GM Muntean… - ACM Computing Surveys …, 2018 - dl.acm.org
Mulsemedia—multiple sensorial media—makes possible the inclusion of layered sensory
stimulation and interaction through multiple sensory channels. The recent upsurge in …

Audio-tactile rendering: a review on technology and methods to convey musical information through the sense of touch

B Remache-Vinueza, A Trujillo-León, M Zapata… - Sensors, 2021 - mdpi.com
Tactile rendering has been implemented in digital musical instruments (DMIs) to offer the
musician haptic feedback that enhances his/her music playing experience. Recently, this …

Touching the audience: musical haptic wearables for augmented and participatory live music performances

L Turchet, T West, MM Wanderley - Personal and Ubiquitous Computing, 2021 - Springer
This paper introduces the musical haptic wearables for audiences (MHWAs), a class of
wearable devices for musical applications targeting audiences of live music performances …

Touch me gently: recreating the perception of touch using a shape-memory alloy matrix

S Muthukumarana, DS Elvitigala… - Proceedings of the …, 2020 - dl.acm.org
We present a wearable forearm augmentation that enables the recreation of natural touch
sensation by applying shear-forces onto the skin. In contrast to previous approaches, we …

HapMotion: motion-to-tactile framework with wearable haptic devices for immersive VR performance experience

K Jung, S Kim, S Oh, SH Yoon - Virtual Reality, 2024 - Springer
We present a novel haptic rendering framework that translates the performer's motions into
wearable vibrotactile feedback for an immersive virtual reality (VR) performance experience …

Generating real-time, selective, and multimodal haptic effects from sound for gaming experience enhancement

G Yun, M Mun, J Lee, DG Kim, HZ Tan… - Proceedings of the 2023 …, 2023 - dl.acm.org
We propose an algorithm that generates a vibration, an impact, or a vibration+ impact haptic
effect by processing a sound signal in real time. Our algorithm is selective in that it matches …

Can haptic stimulation enhance music perception in hearing-impaired listeners?

MD Fletcher - Frontiers in Neuroscience, 2021 - frontiersin.org
Cochlear implants (CIs) have been remarkably successful at restoring hearing in severely-to-
profoundly hearing-impaired individuals. However, users often struggle to deconstruct …

Effect of audio-tactile congruence on vibrotactile music enhancement

SC Aker, H Innes-Brown, KF Faulkner, M Vatti… - The Journal of the …, 2022 - pubs.aip.org
Music listening experiences can be enhanced with tactile vibrations. However, it is not
known which parameters of the tactile vibration must be congruent with the music to …

Understanding tensions in music accessibility through song signing for and with d/Deaf and Non-d/Deaf persons

S Yoo, G Lin, HJ Byeon, AS Hwang… - Proceedings of the 2023 …, 2023 - dl.acm.org
Song signing is a method practiced by people who are d/Deaf and non-d/Deaf individuals to
visually represent music and make music accessible through sign language and body …

FeelMusic: enriching our emotive experience of music through audio-tactile mappings

A Haynes, J Lawry, C Kent, J Rossiter - Multimodal Technologies and …, 2021 - mdpi.com
We present and evaluate the concept of FeelMusic and evaluate an implementation of it. It is
an augmentation of music through the haptic translation of core musical elements. Music …