Enhancing micro gesture recognition for emotion understanding via context-aware visual-text contrastive learning

D Li, B Xing, X Liu - IEEE Signal Processing Letters, 2024 - ieeexplore.ieee.org
Psychological studies have shown that Micro Gestures (MG) are closely linked to human
emotions. MG-based emotion understanding has attracted much attention because it allows …

Multimodal interaction enhanced representation learning for video emotion recognition

X Xia, Y Zhao, D Jiang - Frontiers in Neuroscience, 2022 - frontiersin.org
Video emotion recognition aims to infer human emotional states from the audio, visual, and
text modalities. Previous approaches are centered around designing sophisticated fusion …

PASTFNet: a paralleled attention spatio-temporal fusion network for micro-expression recognition

H Tian, W Gong, W Li, Y Qian - Medical & Biological Engineering & …, 2024 - Springer
Micro-expressions (MEs) play such an important role in predicting a person's genuine
emotions, as to make micro-expression recognition such an important resea rch focus in …

Towards unbiased visual emotion recognition via causal intervention

Y Chen, X Yang, TJ Cham, J Cai - Proceedings of the 30th ACM …, 2022 - dl.acm.org
Although much progress has been made in visual emotion recognition, researchers have
realized that modern deep networks tend to exploit dataset characteristics to learn spurious …

Video emotion recognition in the wild based on fusion of multimodal features

S Chen, X Li, Q Jin, S Zhang, Y Qin - Proceedings of the 18th ACM …, 2016 - dl.acm.org
In this paper, we present our methods to the Audio-Video Based Emotion Recognition
subtask in the 2016 Emotion Recognition in the Wild (EmotiW) Challenge. The task is to …

imigue: An identity-free video dataset for micro-gesture understanding and emotion analysis

X Liu, H Shi, H Chen, Z Yu, X Li… - Proceedings of the …, 2021 - openaccess.thecvf.com
We introduce a new dataset for the emotional artificial intelligence research: identity-free
video dataset for micro-gesture understanding and emotion analysis (iMiGUE). Different …

Sigrep: Toward robust wearable emotion recognition with contrastive representation learning

V Dissanayake, S Seneviratne, R Rana, E Wen… - IEEE …, 2022 - ieeexplore.ieee.org
Extracting emotions from physiological signals has become popular over the past decade.
Recent advancements in wearable smart devices have enabled capturing physiological …

Incomplete multimodality-diffused emotion recognition

Y Wang, Y Li, Z Cui - Advances in Neural Information …, 2024 - proceedings.neurips.cc
Human multimodal emotion recognition (MER) aims to perceive and understand human
emotions via various heterogeneous modalities, such as language, vision, and acoustic …

Semi-supervised multi-modal emotion recognition with cross-modal distribution matching

J Liang, R Li, Q Jin - Proceedings of the 28th ACM international …, 2020 - dl.acm.org
Automatic emotion recognition is an active research topic with wide range of applications.
Due to the high manual annotation cost and inevitable label ambiguity, the development of …

Temporal augmented contrastive learning for micro-expression recognition

T Wang, L Shang - Pattern Recognition Letters, 2023 - Elsevier
Micro-expressions (MEs) can reveal the hidden but real emotion and are usually caused
spontaneously. However, the characteristics of subtlety and temporariness with the lack of …