Unlocking the emotional world of visual media: An overview of the science, research, and impact of understanding emotion

JZ Wang, S Zhao, C Wu, RB Adams… - Proceedings of the …, 2023 - ieeexplore.ieee.org
The emergence of artificial emotional intelligence technology is revolutionizing the fields of
computers and robotics, allowing for a new level of communication and understanding of …

A comprehensive survey on multi-modal conversational emotion recognition with deep learning

Y Shou, T Meng, W Ai, N Yin, K Li - arXiv preprint arXiv:2312.05735, 2023 - arxiv.org
Multi-modal conversation emotion recognition (MCER) aims to recognize and track the
speaker's emotional state using text, speech, and visual information in the conversation …

KnowleNet: Knowledge fusion network for multimodal sarcasm detection

T Yue, R Mao, H Wang, Z Hu, E Cambria - Information Fusion, 2023 - Elsevier
Sarcasm is a form of communication often used to express contempt or ridicule, where the
speaker conveys a message opposite to their true meaning, typically intending to mock or …

Deep learning based multimodal emotion recognition using model-level fusion of audio–visual modalities

AI Middya, B Nag, S Roy - Knowledge-Based Systems, 2022 - Elsevier
Emotion identification based on multimodal data (eg, audio, video, text, etc.) is one of the
most demanding and important research fields, with various uses. In this context, this …

Dynamic interactive multiview memory network for emotion recognition in conversation

J Wen, D Jiang, G Tu, C Liu, E Cambria - Information Fusion, 2023 - Elsevier
When available, multimodal data is key for enhanced emotion recognition in conversation.
Text, audio, and video in dialogues can facilitate and complement each other in analyzing …

A multitask learning model for multimodal sarcasm, sentiment and emotion recognition in conversations

Y Zhang, J Wang, Y Liu, L Rong, Q Zheng, D Song… - Information …, 2023 - Elsevier
Sarcasm, sentiment and emotion are tightly coupled with each other in that one helps the
understanding of another, which makes the joint recognition of sarcasm, sentiment and …

SKIER: A symbolic knowledge integrated model for conversational emotion recognition

W Li, L Zhu, R Mao, E Cambria - … of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
Emotion recognition in conversation (ERC) has received increasing attention from the
research community. However, the ERC task is challenging, largely due to the complex and …

Sentiment-aware multimodal pre-training for multimodal sentiment analysis

J Ye, J Zhou, J Tian, R Wang, J Zhou, T Gui… - Knowledge-Based …, 2022 - Elsevier
Pre-trained models, together with fine-tuning on downstream labeled datasets, have
demonstrated great success in various tasks, including multimodal sentiment analysis …

AOBERT: All-modalities-in-One BERT for multimodal sentiment analysis

K Kim, S Park - Information Fusion, 2023 - Elsevier
Multimodal sentiment analysis utilizes various modalities such as Text, Vision and Speech to
predict sentiment. As these modalities have unique characteristics, methods have been …

Gated attention fusion network for multimodal sentiment classification

Y Du, Y Liu, Z Peng, X Jin - Knowledge-Based Systems, 2022 - Elsevier
Sentiment classification can explore the opinions expressed by people and help them make
better decisions. With the increasing of multimodal contents on the web, such as text, image …