HearMe: Accurate and real-time lip reading based on commercial RFID devices

S Zhang, Z Ma, K Lu, X Liu, J Liu, S Guo… - IEEE Transactions …, 2022 - ieeexplore.ieee.org
Lip reading can help people with speech disorders to communicate with others and provide
them with a new channel to interact with the world. In this paper, we design and implement …

Lip Reading Framework using Deep Learning and Machine Learning

HK Gianey, P Khandelwal, P Goel… - Advances in Data …, 2023 - Wiley Online Library
Lip reading from the lip movements of an individual is a task to interpret the speech being
spoken without actually listening to the speech. This ability of lip‐reading helps speech …

Pushing the limits of remote RF sensing by reading lips under the face mask

H Hameed, M Usman, A Tahir, A Hussain… - Nature …, 2022 - nature.com
The problem of Lip-reading has become an important research challenge in recent years.
The goal is to recognise speech from lip movements. Most of the Lip-reading technologies …

A data-efficient and easy-to-use lip language interface based on wearable motion capture and speech movement reconstruction

S Liu, T Fawden, R Zhu, GG Malliaras, M Bance - Science Advances, 2024 - science.org
Lip language recognition urgently needs wearable and easy-to-use interfaces for
interference-free and high-fidelity lip-reading acquisition and to develop accompanying data …

Acoustic-based Lip Reading for Mobile Devices: Dataset, Benchmark and A Self Distillation-based Approach

Y Yin, Z Wang, K Xia, L Xie, S Lu - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Speech is a natural communication way between people and a good way for human-
computer interaction. However, speech with audible voices often faces the following …

Soundlip: Enabling word and sentence-level lip interaction for smart devices

Q Zhang, D Wang, R Zhao, Y Yu - Proceedings of the ACM on Interactive …, 2021 - dl.acm.org
As a natural and convenient interaction modality, voice input has now become
indispensable to smart devices (eg mobile phones and smart appliances). However, voice …

[PDF][PDF] Lip25w: Word-level lip reading web application for smart device

T Saitoh, M Kubokawa - The 15th International Conference on …, 2019 - avsp2019.loria.fr
Lip reading technology is expected for the next-generation interface. However, there is no
practical system or interface by lip reading that can be easily used by anyone. This paper …

Hearing lips: Improving lip reading by distilling speech recognizers

Y Zhao, R Xu, X Wang, P Hou, H Tang… - Proceedings of the AAAI …, 2020 - aaai.org
Lip reading has witnessed unparalleled development in recent years thanks to deep
learning and the availability of large-scale datasets. Despite the encouraging results …

SilentTalk: Lip reading through ultrasonic sensing on mobile phones

J Tan, CT Nguyen, X Wang - IEEE INFOCOM 2017-IEEE …, 2017 - ieeexplore.ieee.org
The recently enhanced computing capability and rich sensing functionality on mobile
devices lead to the ubiquitous application of speech recognition. Traditional speech …

Review on automatic lip reading techniques

Y Lu, J Yan, K Gu - International Journal of Pattern Recognition and …, 2018 - World Scientific
As a significant component of the Human Computer Interface (HCI), automatic lip reading is
designed for the purpose of understanding the content of speech by interpreting the …