Visual speech information from the speaker's mouth region has been successfully shown to
improve noise robustness of automatic speech recognizers, thus promising to extend their …

We have made significant progress in automatic speech recognition (ASR) for well-defined
applications like dictation and medium vocabulary transaction processing tasks in relatively …

In this paper, we provide a framework based upon diffusion processes for finding meaningful
geometric descriptions of data sets. We show that eigenfunctions of Markov matrices can be …

This paper describes a speech recognition system that uses both acoustic and visual
speech information to improve recognition performance in noisy environments. The system …

The multimodal nature of speech is often ignored in human-computer interaction, but lip
deformations and other body motion, such as those of the head, convey additional …

Data fusion and multicue data matching are fundamental tasks of high-dimensional data
analysis. In this paper, we apply the recently introduced diffusion framework to address …

We have made significant progress in automatic speech recognition ASR for well-defined
applications like dictation and medium vocabulary transaction processing tasks in relatively …

Speech recognition and speaker recognition by machine are crucial ingredients for many
important applications such as natural and flexible human-machine interfaces. Most …

Lipreading refers to understanding and further translating the speech of a video speaker into
textual outputs. State-of-the-art lipreading methods excel in interpreting overlap speakers, ie …

Visual and audiovisual speech recognition are witnessing a renaissance which is largely
due to the advent of deep learning methods. In this paper, we present a deep learning …