Multimodal and temporal perception of audio-visual cues for emotion recognition

E Ghaleb, M Popa, S Asteriadis - 2019 8th international …, 2019 - ieeexplore.ieee.org
In Audio-Video Emotion Recognition (AVER), the idea is to have a human-level
understanding of emotions from video clips. There is a need to bring these two modalities …

DEMoS: an Italian emotional speech corpus: Elicitation methods, machine learning, and perception

E Parada-Cabaleiro, G Costantini, A Batliner… - Language Resources …, 2020 - Springer
Abstract We present DEMoS (Database of Elicited Mood in Speech), a new, large database
with Italian emotional speech: 68 speakers, some 9 k speech samples. As Italian is under …

Auditory, visual, and auditory–visual perceptions of emotions by young children with hearing loss versus children with normal hearing

T Most, H Michaelis - 2012 - ASHA
Purpose This study aimed to investigate the effect of hearing loss (HL) on emotion-
perception ability among young children with and without HL. Method A total of 26 children …

Multimodal attention-mechanism for temporal emotion recognition

E Ghaleb, J Niehues… - 2020 IEEE International …, 2020 - ieeexplore.ieee.org
Exploiting the multimodal and temporal interaction between audio-visual channels is
essential for automatic audio-video emotion recognition (AVER). Modalities' strength in …

The role of voice quality and prosodic contour in affective speech perception

I Grichkovtsova, M Morel, A Lacheret - Speech Communication, 2012 - Elsevier
We explore the usage of voice quality and prosodic contour in the identification of emotions
and attitudes in French. For this purpose, we develop a corpus of affective speech based on …

Joint modelling of audio-visual cues using attention mechanisms for emotion recognition

E Ghaleb, J Niehues, S Asteriadis - Multimedia Tools and Applications, 2023 - Springer
Emotions play a crucial role in human-human communications with complex socio-
psychological nature. In order to enhance emotion communication in human-computer …

Experimental and clinical usefulness of crossmodal paradigms in psychiatry: an illustration from emotional processing in alcohol-dependence

P Maurage, S Campanella - Frontiers in Human Neuroscience, 2013 - frontiersin.org
Crossmodal processing (ie, the construction of a unified representation stemming from
distinct sensorial modalities inputs) constitutes a crucial ability in humans' everyday life. It …

Communicating without the face: holistic perception of emotions of people with facial paralysis

KR Bogart, L Tickle-Degnen… - Basic and Applied Social …, 2014 - Taylor & Francis
People with facial paralysis (FP) report social difficulties, but some attempt to compensate by
increasing expressivity in their bodies and voices. We examined perceivers' emotion …

Emotional speech comprehension in children and adolescents with autism spectrum disorders

S Le Sourn-Bissaoui, M Aguert, P Girard… - Journal of …, 2013 - Elsevier
We examined the understanding of emotional speech by children and adolescents with
autism spectrum disorders (ASD). We predicted that they would have difficulty …

Takete and Maluma in Action: A Cross-Modal Relationship between Gestures and Sounds

K Shinohara, N Yamauchi, S Kawahara, H Tanaka - PloS one, 2016 - journals.plos.org
Despite Saussure's famous observation that sound-meaning relationships are in principle
arbitrary, we now have a substantial body of evidence that sounds themselves can have …