Wavoice: A noise-resistant multi-modal speech recognition system fusing mmwave and audio signals

T Liu, M Gao, F Lin, C Wang, Z Ba, J Han… - Proceedings of the 19th …, 2021 - dl.acm.org
With the advance in automatic speech recognition, voice user interface has gained
popularity recently. Since the COVID-19 pandemic, VUI is increasingly preferred in online …

mSilent: Towards general corpus silent speech recognition using COTS mmWave radar

S Zeng, H Wan, S Shi, W Wang - Proceedings of the ACM on Interactive …, 2023 - dl.acm.org
Silent speech recognition (SSR) allows users to speak to the device without making a
sound, avoiding being overheard or disturbing others. Compared to the video-based …

UFace: Your Smartphone Can" Hear" Your Facial Expression!

S Wang, L Zhong, Y Fu, L Chen, J Ren… - Proceedings of the ACM …, 2024 - dl.acm.org
Facial expression recognition (FER) is a crucial task for human-computer interaction and a
multitude of multimedia applications that typically call for friendly, unobtrusive, ubiquitous …

Experience: practical problems for acoustic sensing

D Li, S Cao, SI Lee, J Xiong - Proceedings of the 28th Annual …, 2022 - dl.acm.org
Acoustic sensing shows great potential to transform billions of consumer-grade electronic
devices that people interact with on a daily basis into ubiquitous sensing platforms. In this …

Enabling contact-free acoustic sensing under device motion

J Liu, D Li, L Wang, F Zhang, J Xiong - … of the ACM on Interactive, Mobile …, 2022 - dl.acm.org
Recent years have witnessed increasing attention from both academia and industry on
contact-free acoustic sensing. Due to the pervasiveness of audio devices and fine …

Sensing to hear: Speech enhancement for mobile devices using acoustic signals

Q Zhang, D Wang, R Zhao, Y Yu, J Shen - Proceedings of the ACM on …, 2021 - dl.acm.org
Voice interactions and voice messages on mobile phones are rapidly growing in popularity.
However, the user experience of these services is still worse than desired in noisy …

EarSE: Bringing Robust Speech Enhancement to COTS Headphones

D Duan, Y Chen, W Xu, T Li - Proceedings of the ACM on Interactive …, 2024 - dl.acm.org
Speech enhancement is regarded as the key to the quality of digital communication and is
gaining increasing attention in the research field of audio processing. In this paper, we …

mmmic: Multi-modal speech recognition based on mmwave radar

L Fan, L Xie, X Lu, Y Li, C Wang… - IEEE INFOCOM 2023 …, 2023 - ieeexplore.ieee.org
With the proliferation of voice assistants, microphone-based speech recognition technology
usually cannot achieve good performance in the situation of multiple sound sources and …

Svoice: Enabling voice communication in silence via acoustic sensing on commodity devices

Y Fu, S Wang, L Zhong, L Chen, J Ren… - Proceedings of the 20th …, 2022 - dl.acm.org
Silent Speech Interface (SSI) has been proposed as a means of reconstructing audible
speech from silent articulatory gestures for covert voice communication in public and voice …

RadioMic: Sound sensing via radio signals

MZ Ozturk, C Wu, B Wang… - IEEE Internet of Things …, 2022 - ieeexplore.ieee.org
Voice interfaces have become an integral part of our lives with the proliferation of smart
devices. Today, Internet of Things devices mainly rely on microphones to sense sound …