Using transformers for multimodal emotion recognition: Taxonomies and state of the art review

S Hazmoune, F Bougamouza - Engineering Applications of Artificial …, 2024 - Elsevier
Emotion recognition is an aspect of human-computer interaction, affective computing, and
social robotics. Conventional unimodal approaches for emotion recognition, depending on …

Linear discriminant analysis

S Zhao, B Zhang, J Yang, J Zhou, Y Xu - Nature Reviews Methods …, 2024 - nature.com
Linear discriminant analysis (LDA) is a versatile statistical method for reducing redundant
and noisy information from an original sample to its essential features. Particularly, LDA is a …

Multimodal emotion recognition with modality-pairwise unsupervised contrastive loss

R Franceschini, E Fini, C Beyan, A Conti… - 2022 26th …, 2022 - ieeexplore.ieee.org
Emotion recognition is involved in several real-world applications. With an increase in
available modalities, automatic understanding of emotions is being performed more …

HiT-MST: Dynamic facial expression recognition with hierarchical transformers and multi-scale spatiotemporal aggregation

X Xia, D Jiang - Information Sciences, 2023 - Elsevier
Facial expression recognition rarely explores complex spatiotemporal dependencies among
facial regions at different scales. This paper proposes a transformer-based three-layer …

Wireless sensing technology combined with facial expression to realize multimodal emotion recognition

X Dang, Z Chen, Z Hao, M Ga, X Han, X Zhang, J Yang - Sensors, 2022 - mdpi.com
Emotions significantly impact human physical and mental health, and, therefore, emotion
recognition has been a popular research area in neuroscience, psychology, and medicine …

Classification of pain expression images in elderly with hip fractures based on improved ResNet50 network

Y Shuang, G Liangbo, Z Huiwen, L Jing… - Frontiers in …, 2024 - frontiersin.org
The aim of this study is designed an improved ResNet 50 network to achieve automatic
classification model for pain expressions by elderly patients with hip fractures. This study …

Behavioral intention of mental health practitioners toward the adoption of virtual humans in affect recognition training

AS García, P Fernández-Sotos, P González… - Frontiers in …, 2022 - frontiersin.org
This paper explores the key factors influencing mental health professionals' behavioral
intention to adopt virtual humans as a means of affect recognition training. Therapies …

Pertinent feature selection techniques for automatic emotion recognition in stressed speech

P Tiwari, AD Darji - International Journal of Speech Technology, 2022 - Springer
Recently, the recognition of the emotional state or stress level of a user has been accepted
as an emerging research topic in the field of human–machine interface and psychiatry …

Emotion Detection Based on Consecutive Facial by Combining CNN and LSTM Implemented on FPGA Chip

ST Pan, HJ Wu - 2024 - preprints.org
This paper proposed emotion recognition methods for consecutive facial images, and
implements the inference of neural network model on a field-programmable gate array …

Automated Pain Assessment Increases Nurses' Working Efficiency in elderly with hip fractures

S Yang, L Gong, H Zhao, J Liu, X Chen, S Shen, X Zhu… - 2023 - researchsquare.com
The aim of this study was to design a modified ResNet 50 algorithm to achieve automatic
classification model for pain expressions by elderly patients with hip fractures. We built a …