Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions

A Gandhi, K Adhvaryu, S Poria, E Cambria, A Hussain - Information Fusion, 2023 - Elsevier
Sentiment analysis (SA) has gained much traction In the field of artificial intelligence (AI) and
natural language processing (NLP). There is growing demand to automate analysis of user …

A systematic literature review on multimodal machine learning: Applications, challenges, gaps and future directions

A Barua, MU Ahmed, S Begum - IEEE Access, 2023 - ieeexplore.ieee.org
Multimodal machine learning (MML) is a tempting multidisciplinary research area where
heterogeneous data from multiple modalities and machine learning (ML) are combined to …

Hybrid contrastive learning of tri-modal representation for multimodal sentiment analysis

S Mai, Y Zeng, S Zheng, H Hu - IEEE Transactions on Affective …, 2022 - ieeexplore.ieee.org
The wide application of smart devices enables the availability of multimodal data, which can
be utilized in many tasks. In the field of multimodal sentiment analysis, most previous works …

Sentiment analysis and topic recognition in video transcriptions

L Stappen, A Baird, E Cambria… - IEEE Intelligent …, 2021 - ieeexplore.ieee.org
Nowadays, videos are an integral modality for information sharing on the World Wide Web.
However, systems able to automatically understand the content and sentiment of a video are …

Authorship identification using ensemble learning

A Abbasi, AR Javed, F Iqbal, Z Jalil, TR Gadekallu… - Scientific reports, 2022 - nature.com
With time, textual data is proliferating, primarily through the publications of articles. With this
rapid increase in textual data, anonymous content is also increasing. Researchers are …

The MuSe 2021 multimodal sentiment analysis challenge: sentiment, emotion, physiological-emotion, and stress

L Stappen, A Baird, L Christ, L Schumann… - Proceedings of the 2nd …, 2021 - dl.acm.org
Multimodal Sentiment Analysis (MuSe) 2021 is a challenge focusing on the tasks of
sentiment and emotion, as well as physiological-emotion and emotion-based stress …

Efficient multimodal transformer with dual-level feature restoration for robust multimodal sentiment analysis

L Sun, Z Lian, B Liu, J Tao - IEEE Transactions on Affective …, 2023 - ieeexplore.ieee.org
With the proliferation of user-generated online videos, Multimodal Sentiment Analysis (MSA)
has attracted increasing attention recently. Despite significant progress, there are still two …

The muse 2022 multimodal sentiment analysis challenge: humor, emotional reactions, and stress

L Christ, S Amiriparian, A Baird, P Tzirakis… - Proceedings of the 3rd …, 2022 - dl.acm.org
The Multimodal Sentiment Analysis Challenge (MuSe) 2022 is dedicated to multimodal
sentiment and emotion recognition. For this year's challenge, we feature three datasets:(i) …

MuSe-Toolbox: The Multimodal Sentiment Analysis Continuous Annotation Fusion and Discrete Class Transformation Toolbox

L Stappen, L Schumann, B Sertolli, A Baird… - Proceedings of the 2nd …, 2021 - dl.acm.org
We introduce the MuSe-Toolbox-a Python-based open-source toolkit for creating a variety of
continuous and discrete emotion gold standards. In a single framework, we unify a wide …

Multimodal sentiment analysis: A survey

S Lai, X Hu, H Xu, Z Ren, Z Liu - Displays, 2023 - Elsevier
Multimodal sentiment analysis has emerged as a prominent research field within artificial
intelligence, benefiting immensely from recent advancements in deep learning. This …