Align and attend: Multimodal summarization with dual contrastive losses

B He, J Wang, J Qiu, T Bui… - Proceedings of the …, 2023 - openaccess.thecvf.com
The goal of multimodal summarization is to extract the most important information from
different modalities to form summaries. Unlike unimodal summarization, the multimodal …

Align and Attend: Multimodal Summarization with Dual Contrastive Losses

B He, J Wang, J Qiu, T Bui, A Shrivastava… - arXiv e …, 2023 - ui.adsabs.harvard.edu
The goal of multimodal summarization is to extract the most important information from
different modalities to form output summaries. Unlike the unimodal summarization, the …

Align and Attend: Multimodal Summarization with Dual Contrastive Losses

B He, J Wang, J Qiu, T Bui, A Shrivastava… - 2023 IEEE/CVF …, 2023 - computer.org
The goal of multimodal summarization is to extract the most important information from
different modalities to form summaries. Unlike unimodal summarization, the multimodal …

Align and Attend: Multimodal Summarization with Dual Contrastive Losses

B He - cvpr.thecvf.com
● Goal: Utilize intrinsic relationships between input multimodal data pair.● Motivation:
Paired video and text sample shares mutual information.● Solution: Maximize the cosine …

Align and Attend: Multimodal Summarization with Dual Contrastive Losses

B He, J Wang, J Qiu, T Bui… - 2023 IEEE/CVF …, 2023 - ieeexplore.ieee.org
The goal of multimodal summarization is to extract the most important information from
different modalities to form summaries. Unlike unimodal summarization, the multimodal …

Align and Attend: Multimodal Summarization with Dual Contrastive Losses

B He, J Wang, J Qiu, T Bui, A Shrivastava… - arXiv preprint arXiv …, 2023 - arxiv.org
The goal of multimodal summarization is to extract the most important information from
different modalities to form output summaries. Unlike the unimodal summarization, the …

[PDF][PDF] Align and Attend: Multimodal Summarization with Dual Contrastive Losses

B He, J Wang, J Qiu, T Bui, A Shrivastava, Z Wang - researchgate.net
The goal of multimodal summarization is to extract the most important information from
different modalities to form summaries. Unlike unimodal summarization, the multimodal …