Mm-llms: Recent advances in multimodal large language models

D Zhang, Y Yu, C Li, J Dong, D Su, C Chu… - arXiv preprint arXiv …, 2024 - arxiv.org
In the past year, MultiModal Large Language Models (MM-LLMs) have undergone
substantial advancements, augmenting off-the-shelf LLMs to support MM inputs or outputs …

Heterogeneous forgetting compensation for class-incremental learning

J Dong, W Liang, Y Cong… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Class-incremental learning (CIL) has achieved remarkable successes in learning new
classes consecutively while overcoming catastrophic forgetting on old categories. However …

Expandable subspace ensemble for pre-trained model-based class-incremental learning

DW Zhou, HL Sun, HJ Ye… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Abstract Class-Incremental Learning (CIL) requires a learning system to continually learn
new classes without forgetting. Despite the strong performance of Pre-Trained Models …

Primitive generation and semantic-related alignment for universal zero-shot segmentation

S He, H Ding, W Jiang - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
We study universal zero-shot segmentation in this work to achieve panoptic, instance, and
semantic segmentation for novel categories without any training samples. Such zero-shot …

Task relation distillation and prototypical pseudo label for incremental named entity recognition

D Zhang, H Li, W Cong, R Xu, J Dong… - Proceedings of the 32nd …, 2023 - dl.acm.org
Incremental Named Entity Recognition (INER) involves the sequential learning of new entity
types without accessing the training data of previously learned types. However, INER faces …

Self-paced weight consolidation for continual learning

W Cong, Y Cong, G Sun, Y Liu… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Continual learning algorithms which keep the parameters of new tasks close to that of
previous tasks, are popular in preventing catastrophic forgetting in sequential task learning …

Point Segment and Count: A Generalized Framework for Object Counting

Z Huang, M Dai, Y Zhang, J Zhang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Class-agnostic object counting aims to count all objects in an image with respect to example
boxes or class names aka few-shot and zero-shot counting. In this paper we propose a …

Continual named entity recognition without catastrophic forgetting

D Zhang, W Cong, J Dong, Y Yu, X Chen… - arXiv preprint arXiv …, 2023 - arxiv.org
Continual Named Entity Recognition (CNER) is a burgeoning area, which involves updating
an existing model by incorporating new entity types sequentially. Nevertheless, continual …

Gradient-semantic compensation for incremental semantic segmentation

W Cong, Y Cong, J Dong, G Sun… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Incremental semantic segmentation focuses on continually learning the segmentation of
new coming classes without obtaining the training data from previously seen classes …

Decomposing logits distillation for incremental named entity recognition

D Zhang, Y Yu, F Chen, X Chen - … of the 46th International ACM SIGIR …, 2023 - dl.acm.org
Incremental Named Entity Recognition (INER) aims to continually train a model with new
data, recognizing emerging entity types without forgetting previously learned ones. Prior …