EchoSpeech: Continuous Silent Speech Recognition on Minimally-obtrusive Eyewear Powered by Acoustic Sensing

R Zhang, K Li, Y Hao, Y Wang, Z Lai… - Proceedings of the …, 2023 - dl.acm.org
We present EchoSpeech, a minimally-obtrusive silent speech interface (SSI) powered by
low-power active acoustic sensing. EchoSpeech uses speakers and microphones mounted …

EarCommand: " Hearing" Your Silent Speech Commands In Ear

Y Jin, Y Gao, X Xu, S Choi, J Li, F Liu, Z Li… - Proceedings of the ACM …, 2022 - dl.acm.org
Intelligent speech interfaces have been developing vastly to support the growing demands
for convenient control and interaction with wearable/earable and portable devices. To avoid …

Muteit: Jaw motion based unvoiced command recognition using earable

T Srivastava, P Khanna, S Pan, P Nguyen… - Proceedings of the ACM …, 2022 - dl.acm.org
In this paper, we present MuteIt, an ear-worn system for recognizing unvoiced human
commands. MuteIt presents an intuitive alternative to voice-based interactions that can be …

Liplearner: Customizable silent speech interactions on mobile devices

Z Su, S Fang, J Rekimoto - Proceedings of the 2023 CHI Conference on …, 2023 - dl.acm.org
Silent speech interface is a promising technology that enables private communications in
natural language. However, previous approaches only support a small and inflexible …

Speechin: A smart necklace for silent speech recognition

R Zhang, M Chen, B Steeper, Y Li, Z Yan… - Proceedings of the …, 2021 - dl.acm.org
This paper presents SpeeChin, a smart necklace that can recognize 54 English and 44
Chinese silent speech commands. A customized infrared (IR) imaging system is mounted on …

HPSpeech: Silent Speech Interface for Commodity Headphones

R Zhang, H Chen, D Agarwal, R Jin, K Li… - Proceedings of the …, 2023 - dl.acm.org
We present HPSpeech, a silent speech interface for commodity headphones. HPSpeech
utilizes the existing speakers of the headphones to emit inaudible acoustic signals. The …

Whispering wearables: Multimodal approach to silent speech recognition with head-worn devices

T Srivastava, RM Winters, T Gable, YT Wang… - Proceedings of the 26th …, 2024 - dl.acm.org
Silent speech recognition has emerged as a promising approach for enabling hands-free
and discreet interaction with head-worn devices. In this paper, we present QuietSync, a …

Gaze+ Lip: rapid, precise and expressive interactions combining gaze input and silent speech commands for hands-free smart TV control

Z Su, X Zhang, N Kimura, J Rekimoto - ACM symposium on eye tracking …, 2021 - dl.acm.org
As eye-tracking technologies develop, gaze becomes more and more popular as an input
modality. However, in situations that require fast and precise object selection, gaze is hard to …

Robust dual-modal speech keyword spotting for XR headsets

Z Cai, Y Ma, F Lu - IEEE Transactions on Visualization and …, 2024 - ieeexplore.ieee.org
While speech interaction finds widespread utility within the Extended Reality (XR) domain,
conventional vocal speech keyword spotting systems continue to grapple with formidable …

E-MASK: a mask-shaped interface for silent speech interaction with flexible strain sensors

Y Kunimi, M Ogata, H Hiraki, M Itagaki… - Proceedings of the …, 2022 - dl.acm.org
We present E-MASK, a mask-shaped interface for silent speech interaction. As face masks
have become daily accessories since the COVID-19 pandemic, it is reasonable to utilize a …