Generating real-time, selective, and multimodal haptic effects from sound for gaming experience enhancement

G Yun, M Mun, J Lee, DG Kim, HZ Tan… - Proceedings of the 2023 …, 2023 - dl.acm.org
We propose an algorithm that generates a vibration, an impact, or a vibration+ impact haptic
effect by processing a sound signal in real time. Our algorithm is selective in that it matches …

Perceptual Relevance of Haptic Feedback during Virtual Plucking, Bowing and Rubbing of Physically-Based Musical Resonators

MG Onofrei, F Fontana, S Serafin - Arts, 2023 - mdpi.com
The physics-based design and realization of a digital musical interface asks for the modeling
and implementation of the contact-point interaction with the performer. Musical instruments …

Touch the sound: audio-driven tactile feedback for audio mixing applications

S Merchel, ME Altinsoy, M Stamm - Journal of the Audio Engineering …, 2012 - aes.org
In this study experiments were conducted to determine if a person could distinguish
percussive audio loops by their fingertips using audio-driven tactile feedback. The audio …

[PDF][PDF] Design of vibrotactile feedback and stimulation for music performance

M Giordano, J Sullivan, MM Wanderley - Musical haptics, 2018 - library.oapen.org
Haptics, and specifically vibrotactile-augmented interfaces, have been the object of much
research in the music technology domain: In the last few decades, many musical haptic …

Method for Audio-to-Tactile Cross-Modality Generation Based on Residual U-Net

Y Zhan, X Sun, Q Wang, W Nai - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Extensive research has been conducted investigating various facets in the realm of
multimodal modeling. Nevertheless, there has been a lack of systematic exploration in the …

[HTML][HTML] Assessing the Impact of Force Feedback in Musical Knobs on Performance and User Experience

Z Piao, C Frisson, BV Kerrebroeck, MM Wanderley - Actuators, 2024 - mdpi.com
This paper examined how rotary force feedback in knobs can enhance control over musical
techniques, focusing on both performance and user experience. To support our study, we …

Haptic display of melodic intervals for musical applications

DC Egloff, MM Wanderley… - 2018 IEEE Haptics …, 2018 - ieeexplore.ieee.org
The focus of this study was to investigate the ability to discriminate between melodic
intervals of the equal tempered scale based solely on vibrotactile stimulation. In music, a …

Towards an interface for music mixing based on smart tangibles and multitouch

S Gelineck, D Overholt, M Büchert, J Andersen - NIME 2013, 2013 - vbn.aau.dk
This paper presents the continuous work towards the development of an interface for music
mixing targeted towards expert sound technicians and producers. The mixing interface uses …

Interacting with digital audio effects through a haptic knob with programmable resistance

Y De Pra, F Fontana, S Papetti - 2021 24th International …, 2021 - ieeexplore.ieee.org
Live music performances and music production often involve the manipulation of several
parameters during sound generation, processing, and mixing. In hardware layouts, those …

[图书][B] Vibrotactile perception of musical pitch

S Maté-Cid - 2014 - search.proquest.com
Previous vibrotactile research has provided little or no definitive results on the discrimination
and identification of important pitch aspects for musical performance such as relative and …