Adaptive Graph Learning for Multimodal Conversational Emotion Detection

G Tu, T Xie, B Liang, H Wang, R Xu - … of the AAAI Conference on Artificial …, 2024 - ojs.aaai.org
Multimodal Emotion Recognition in Conversations (ERC) aims to identify the emotions
conveyed by each utterance in a conversational video. Current efforts encounter challenges …

Multimodal sentiment analysis using deep learning and fuzzy logic: A comprehensive survey

HN Do, HT Phan, NT Nguyen - Applied Soft Computing, 2024 - Elsevier
Multimodal sentiment analysis (MSA) is the process of identifying sentiment polarities that
users may simultaneously display in text, audio, and video data. Sentiment analysis …

Sarcasm driven by sentiment: A sentiment-aware hierarchical fusion network for multimodal sarcasm detection

H Liu, R Wei, G Tu, J Lin, C Liu, D Jiang - Information Fusion, 2024 - Elsevier
Sarcasm is a form of sentiment expression that highlights the disparity between a person's
true intentions and the content they explicitly present. With the exponential increase in …

Self-supervised utterance order prediction for emotion recognition in conversations

D Jiang, H Liu, G Tu, R Wei, E Cambria - Neurocomputing, 2024 - Elsevier
As the order of the utterances in a conversation changes, the meaning of the utterance also
changes, and sometimes, this will cause different semantics or emotions. However, the …

Multi-modal sarcasm detection with sentiment word embedding

H Fu, H Liu, H Wang, L Xu, J Lin, D Jiang - Electronics, 2024 - mdpi.com
Sarcasm poses a significant challenge for detection due to its unique linguistic phenomenon
where the intended meaning is often opposite of the literal expression. Current sarcasm …

A multi-view interactive approach for multimodal sarcasm detection in social internet of things with knowledge enhancement

H Liu, B Yang, Z Yu - Applied Sciences, 2024 - mdpi.com
Multimodal sarcasm detection is a developing research field in social Internet of Things,
which is the foundation of artificial intelligence and human psychology research. Sarcastic …

Emotion Recognition by Video: A review

J Xue, J Wang, X Wu, L Fu - arXiv preprint arXiv:2310.17212, 2023 - arxiv.org
Video emotion recognition is an important branch of affective computing, and its solutions
can be applied in different fields such as human-computer interaction (HCI) and intelligent …

Learning More from Mixed Emotions: A Label Refinement Method for Emotion Recognition in Conversations

J Wen, G Tu, R Li, D Jiang, W Zhu - Transactions of the Association …, 2023 - direct.mit.edu
One-hot labels are commonly employed as ground truth in Emotion Recognition in
Conversations (ERC). However, this approach may not fully encompass all the emotions …

A Persona-Infused Cross-Task Graph Network for Multimodal Emotion Recognition with Emotion Shift Detection in Conversations

G Tu, F Xiong, B Liang, R Xu - Proceedings of the 47th International ACM …, 2024 - dl.acm.org
Recent research in Multimodal Emotion Recognition in Conversations (MERC) focuses on
multimodal fusion and modeling speaker-sensitive context. In addition to contextual …

Dialogue emotion model based on local–global context encoder and commonsense knowledge fusion attention

W Yu, C Li, X Hu, W Zhu, E Cambria… - International Journal of …, 2024 - Springer
Abstract Emotion Recognition in Conversation (ERC) is a task aimed at predicting the
emotions conveyed by an utterance in a dialogue. It is common in ERC research to integrate …