Isolation and impartial aggregation: A paradigm of incremental learning without interference

Y Wang, Z Ma, Z Huang, Y Wang, Z Su… - Proceedings of the AAAI …, 2023 - ojs.aaai.org
This paper focuses on the prevalent stage interference and stage performance imbalance of
incremental learning. To avoid obvious stage learning bottlenecks, we propose a new …

Initial classifier weights replay for memoryless class incremental learning

E Belouadah, A Popescu, I Kanellos - arXiv preprint arXiv:2008.13710, 2020 - arxiv.org
Incremental Learning (IL) is useful when artificial systems need to deal with streams of data
and do not have access to all data at all times. The most challenging setting requires a …

Learning a unified classifier incrementally via rebalancing

S Hou, X Pan, CC Loy, Z Wang… - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
Conventionally, deep neural networks are trained offline, relying on a large dataset
prepared in advance. This paradigm is often challenged in real-world applications, eg online …

Prototype augmentation and self-supervision for incremental learning

F Zhu, XY Zhang, C Wang, F Yin… - Proceedings of the …, 2021 - openaccess.thecvf.com
Despite the impressive performance in many individual tasks, deep neural networks suffer
from catastrophic forgetting when learning new tasks incrementally. Recently, various …

Large scale incremental learning

Y Wu, Y Chen, L Wang, Y Ye, Z Liu… - Proceedings of the …, 2019 - openaccess.thecvf.com
Modern machine learning suffers from catastrophic forgetting when learning new classes
incrementally. The performance dramatically degrades due to the missing data of old …

Class-incremental learning via deep model consolidation

J Zhang, J Zhang, S Ghosh, D Li… - Proceedings of the …, 2020 - openaccess.thecvf.com
Deep neural networks (DNNs) often suffer from" catastrophic forgetting" during incremental
learning (IL)---an abrupt degradation of performance on the original set of classes when the …

Mimicking the oracle: An initial phase decorrelation approach for class incremental learning

Y Shi, K Zhou, J Liang, Z Jiang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract Class Incremental Learning (CIL) aims at learning a classifier in a phase-by-phase
manner, in which only data of a subset of the classes are provided at each phase. Previous …

Energy-based latent aligner for incremental learning

KJ Joseph, S Khan, FS Khan… - Proceedings of the …, 2022 - openaccess.thecvf.com
Deep learning models tend to forget their earlier knowledge while incrementally learning
new tasks. This behavior emerges because the parameter updates optimized for the new …

Looking back on learned experiences for class/task incremental learning

M PourKeshavarzi, G Zhao… - … Conference on Learning …, 2022 - openreview.net
Classical deep neural networks are limited in their ability to learn from emerging streams of
training data. When trained sequentially on new or evolving tasks, their performance …

Adaptive deep models for incremental learning: Considering capacity scalability and sustainability

Y Yang, DW Zhou, DC Zhan, H Xiong… - Proceedings of the 25th …, 2019 - dl.acm.org
Recent years have witnessed growing interests in developing deep models for incremental
learning. However, existing approaches often utilize the fixed structure and online …