In this paper, we review recent results on audiovisual (AV) fusion. We also discuss some of
the challenges and report on approaches to address them. One important issue in AV fusion …

This paper presents an approach to the automatic recognition of human emotions from
audio-visual bimodal signals using an error weighted semi-coupled hidden Markov model …

Emotion expression associated with human communication is known to be a multimodal
process. In this work, we investigate the way that emotional information is conveyed by facial …

Emotion is expressed and perceived through multiple modalities. In this work, we model
face, voice and head movement cues for emotion recognition and we fuse classifiers using a …

This paper describes a new approach to combine multiple modalities and applies it to the
problem of affect recognition. The problem is posed as a combination of classifiers in a …

Music is often processed through its acoustic realization. This is restrictive in the sense that
music is clearly a highly multimodal concept where various types of heterogeneous …

We explore different strategies for classifier combination within the framework of component-
based face recognition. In our current system, the gray values of facial components are …

This thesis investigates the developing of robust and reliable automatic speech recognition
system based on the processing of audio (voiced speech) and video (lip-reading) …

Occlusive effect is a crucial issue that may dramatically degrade performance on facial
expression recognition. As emotion recognition from facial expression is based on the entire …

We propose a method for recognizing ingredients in food preparing activity. The research for
object recognition mainly focuses on only visual information; however, ingredients are …