People naturally interact with the world multimodally, through both parallel and sequential
use of multiple perceptual modalities. Multimodal human–computer interaction has sought …

The ability to recognize affective states of a person we are communicating with is the core of
emotional intelligence. Emotional intelligence is a facet of human intelligence that has been …

Automatic audio-visual speech recognition currently lags behind its audio-only counterpart
in terms of major progress. One of the reasons commonly cited by researchers is the scarcity …

Visual speech information from the speaker's mouth region has been successfully shown to
improve noise robustness of automatic speech recognizers, thus promising to extend their …

Sight and hearing are two senses that play a vital role in human communication and scene
understanding. To mimic human perception ability, audio-visual learning, aimed at …

We have made significant progress in automatic speech recognition (ASR) for well-defined
applications like dictation and medium vocabulary transaction processing tasks in relatively …

The use of visual features in audio-visual speech recognition (AVSR) is justified by both the
speech generation mechanism, which is essentially bimodal in audio and visual …

(AI). It also considers the integration of neural networks with other computing methods Such
as fuzzy logic to enhance the interpretation ability of data. Artificial Neural Networks is …

Visual speech, referring to the visual domain of speech, has attracted increasing attention
due to its wide applications, such as public security, medical treatment, military defense, and …

In recent years several speech recognition systems that use visual together with audio
information showed significant increase in performance over the standard speech …