Meta-optimized Angular Margin Contrastive Framework for Video-Language Representation Learning
Data quality stands at the forefront of deciding the effectiveness of video-language
representation learning. However, video-text pairs in previous data typically do not align …
representation learning. However, video-text pairs in previous data typically do not align …
Kdmcse: Knowledge distillation multimodal sentence embeddings with adaptive angular margin contrastive learning
Previous work on multimodal sentence embedding has proposed multimodal contrastive
learning and achieved promising results. However, by taking the rest of the batch as …
learning and achieved promising results. However, by taking the rest of the batch as …
Topic Modeling as Multi-Objective Contrastive Optimization
Recent representation learning approaches enhance neural topic models by optimizing the
weighted linear combination of the evidence lower bound (ELBO) of the log-likelihood and …
weighted linear combination of the evidence lower bound (ELBO) of the log-likelihood and …
Transformer-based correlation mining network with self-supervised label generation for multimodal sentiment analysis
R Wang, Q Yang, S Tian, L Yu, X He, B Wang - Neurocomputing, 2025 - Elsevier
Abstract Multimodal Sentiment Analysis (MSA) aims to recognize and understand a
speaker's sentiment state by integrating information from natural language, facial …
speaker's sentiment state by integrating information from natural language, facial …
Multi-Scale Contrastive Learning for Video Temporal Grounding
Temporal grounding, which localizes video moments related to a natural language query, is
a core problem of vision-language learning and video understanding. To encode video …
a core problem of vision-language learning and video understanding. To encode video …
Motion-aware Contrastive Learning for Temporal Panoptic Scene Graph Generation
To equip artificial intelligence with a comprehensive understanding towards a temporal
world, video and 4D panoptic scene graph generation abstracts visual data into nodes to …
world, video and 4D panoptic scene graph generation abstracts visual data into nodes to …
Video-Language Understanding: A Survey from Model Architecture, Model Training, and Data Perspectives
Humans use multiple senses to comprehend the environment. Vision and language are two
of the most vital senses since they allow us to easily communicate our thoughts and …
of the most vital senses since they allow us to easily communicate our thoughts and …
Topic-Aware Causal Intervention for Counterfactual Detection
Counterfactual statements, which describe events that did not or cannot take place, are
beneficial to numerous NLP applications. Hence, we consider the problem of counterfactual …
beneficial to numerous NLP applications. Hence, we consider the problem of counterfactual …
Enhancing Multimodal Entity Linking with Jaccard Distance-based Conditional Contrastive Learning and Contextual Visual Augmentation
Previous research on multimodal entity linking (MEL) has primarily employed contrastive
learning as the primary objective. However, using the rest of the batch as negative samples …
learning as the primary objective. However, using the rest of the batch as negative samples …
PSACF: Parallel-Serial Attention-Based Cross-Fusion for Multimodal Emotion Recognition
Y Zhang, Y Liu, C Cheng - 2024 IEEE International Conference …, 2024 - ieeexplore.ieee.org
Multimodal emotion recognition (MER) has significantly improved by integrating features
from various modalities. However, imbalances and heterogeneity among modalities often …
from various modalities. However, imbalances and heterogeneity among modalities often …