A comparative review on multi-modal sensors fusion based on deep learning

Q Tang, J Liang, F Zhu - Signal Processing, 2023 - Elsevier
The wide deployment of multi-modal sensors in various areas generates vast amounts of
data with characteristics of high volume, wide variety, and high integrity. However, traditional …

A survey on deep learning for multimodal data fusion

J Gao, P Li, Z Chen, J Zhang - Neural Computation, 2020 - direct.mit.edu
With the wide deployments of heterogeneous networks, huge amounts of data with
characteristics of high volume, high variety, high velocity, and high veracity are generated …

Multilevel sensor fusion with deep learning

V Vielzeuf, A Lechervy, S Pateux, F Jurie - IEEE sensors letters, 2018 - ieeexplore.ieee.org
In the context of deep learning, this article presents an original deep network, namely
CentralNet, for the fusion of information coming from different sensors. This approach is …

Giobalfusion: A global attentional deep learning framework for multisensor information fusion

S Liu, S Yao, J Li, D Liu, T Wang, H Shao… - Proceedings of the …, 2020 - dl.acm.org
The paper enhances deep-neural-network-based inference in sensing applications by
introducing a lightweight attention mechanism called the global attention module for multi …

Deep multimodal fusion by channel exchanging

Y Wang, W Huang, F Sun, T Xu… - Advances in neural …, 2020 - proceedings.neurips.cc
Deep multimodal fusion by using multiple sources of data for classification or regression has
exhibited a clear advantage over the unimodal counterpart on various applications. Yet …

Memory based fusion for multi-modal deep learning

D Priyasad, T Fernando, S Denman, S Sridharan… - Information …, 2021 - Elsevier
The use of multi-modal data for deep machine learning has shown promise when compared
to uni-modal approaches with fusion of multi-modal features resulting in improved …

[HTML][HTML] Multimodal image fusion: A systematic review

S Kalamkar - Decision Analytics Journal, 2023 - Elsevier
Multimodal image fusion combines information from multiple modalities to generate a
composite image containing complementary information. Multimodal image fusion is …

MMTM: Multimodal transfer module for CNN fusion

HRV Joze, A Shaban, ML Iuzzolino… - Proceedings of the …, 2020 - openaccess.thecvf.com
In late fusion, each modality is processed in a separate unimodal Convolutional Neural
Network (CNN) stream and the scores of each modality are fused at the end. Due to its …

Deep multimodal fusion of image and non-image data in disease diagnosis and prognosis: a review

C Cui, H Yang, Y Wang, S Zhao, Z Asad… - Progress in …, 2023 - iopscience.iop.org
The rapid development of diagnostic technologies in healthcare is leading to higher
requirements for physicians to handle and integrate the heterogeneous, yet complementary …

[HTML][HTML] Deep learning in multimodal remote sensing data fusion: A comprehensive review

J Li, D Hong, L Gao, J Yao, K Zheng, B Zhang… - International Journal of …, 2022 - Elsevier
With the extremely rapid advances in remote sensing (RS) technology, a great quantity of
Earth observation (EO) data featuring considerable and complicated heterogeneity are …