Deep multi-view learning methods: A review

X Yan, S Hu, Y Mao, Y Ye, H Yu - Neurocomputing, 2021 - Elsevier
Multi-view learning (MVL) has attracted increasing attention and achieved great practical
success by exploiting complementary information of multiple features or modalities …

A review on methods and applications in multimodal deep learning

S Jabeen, X Li, MS Amin, O Bourahla, S Li… - ACM Transactions on …, 2023 - dl.acm.org
Deep Learning has implemented a wide range of applications and has become increasingly
popular in recent years. The goal of multimodal deep learning (MMDL) is to create models …

[HTML][HTML] Information retrieval meets large language models: a strategic report from chinese ir community

Q Ai, T Bai, Z Cao, Y Chang, J Chen, Z Chen, Z Cheng… - AI Open, 2023 - Elsevier
The research field of Information Retrieval (IR) has evolved significantly, expanding beyond
traditional search to meet diverse user information needs. Recently, Large Language …

Binding touch to everything: Learning unified multimodal tactile representations

F Yang, C Feng, Z Chen, H Park… - Proceedings of the …, 2024 - openaccess.thecvf.com
The ability to associate touch with other modalities has huge implications for humans and
computational systems. However multimodal learning with touch remains challenging due to …

[HTML][HTML] Multibench: Multiscale benchmarks for multimodal representation learning

PP Liang, Y Lyu, X Fan, Z Wu, Y Cheng… - Advances in neural …, 2021 - ncbi.nlm.nih.gov
Learning multimodal representations involves integrating information from multiple
heterogeneous sources of data. It is a challenging yet crucial area with numerous real-world …

Detecting fake news by exploring the consistency of multimodal data

J Xue, Y Wang, Y Tian, Y Li, L Shi, L Wei - Information Processing & …, 2021 - Elsevier
During the outbreak of the new Coronavirus (2019-nCoV) in 2020, the spread of fake news
has caused serious social panic. Fake news often uses multimedia information such as text …

Hyperspectral and multispectral classification for coastal wetland using depthwise feature interaction network

Y Gao, W Li, M Zhang, J Wang, W Sun… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
The monitoring of coastal wetlands is of great importance to the protection of marine and
terrestrial ecosystems. However, due to the complex environment, severe vegetation …

Joint-modal distribution-based similarity hashing for large-scale unsupervised deep cross-modal retrieval

S Liu, S Qian, Y Guan, J Zhan, L Ying - Proceedings of the 43rd …, 2020 - dl.acm.org
Hashing-based cross-modal search which aims to map multiple modality features into binary
codes has attracted increasingly attention due to its storage and search efficiency especially …

Multi-modal hashing for efficient multimedia retrieval: A survey

L Zhu, C Zheng, W Guan, J Li, Y Yang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
With the explosive growth of multimedia contents, multimedia retrieval is facing
unprecedented challenges on both storage cost and retrieval speed. Hashing technique can …

Learning cross-modal retrieval with noisy labels

P Hu, X Peng, H Zhu, L Zhen… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Recently, cross-modal retrieval is emerging with the help of deep multimodal learning.
However, even for unimodal data, collecting large-scale well-annotated data is expensive …