Efficient feature transformations for discriminative and generative continual learning

VK Verma, KJ Liang, N Mehta… - Proceedings of the …, 2021 - openaccess.thecvf.com
feature map transformation for largescale continual learning, which we call Efficient Feature
Transformation (… Finally, we propose a strategy for maximizing feature distance to improve …

Contextual transformation networks for online continual learning

Q Pham, C Liu, D Sahoo, HOI Steven - … Conference on Learning …, 2021 - openreview.net
… , online continual learning is … learning on a stream of tasks, which is ubiquitous in realistic
scenarios. Thus, in this work, we focus on the continual learning setting in an online learning

FeTT: Continual Class Incremental Learning via Feature Transformation Tuning

S Qiang, X Lin, Y Liang, J Wan, D Zhang - arXiv preprint arXiv:2405.11822, 2024 - arxiv.org
… (1) This paper proposes to employ PTMs in the continual learning scenario with different
tuning strategies. However, further exploration of the performance of different PTMs, such as …

Dualnet: Continual learning, fast and slow

Q Pham, C Liu, S Hoi - Advances in Neural Information …, 2021 - proceedings.neurips.cc
… DualNet for the online continual learning settings [36… In the batch continual learning setting
[46], the model is allowed to … Particularly, instead of generating the transformation coefficients …

Fecam: Exploiting the heterogeneity of class distributions in exemplar-free continual learning

D Goswami, Y Liu, B Twardowski… - Advances in Neural …, 2024 - proceedings.neurips.cc
… We show that Tukeys transformation significantly reduces the skewness of the distributions
transformation, we observe that the new class features are comparatively better clustered. …

Scalable adversarial online continual learning

T Dam, M Pratama, MDM Ferdaus, S Anavatti… - … on Machine Learning …, 2022 - Springer
… We offer an alternative approach here where private features are induced by the feature
transformation strategy of [21] and the adversarial game is played by one and only one …

CLR: Channel-wise lightweight reprogramming for continual learning

Y Ge, Y Li, S Ni, J Zhao… - Proceedings of the …, 2023 - openaccess.thecvf.com
… could be reprogrammed with a task-dependent linear transformation. The main contributions
of this work are: • We propose a novel continual learning solution for CNNs, which involves …

Preserving earlier knowledge in continual learning with the help of all previous feature extractors

Z Li, C Zhong, S Liu, R Wang, WS Zheng - arXiv preprint arXiv:2104.13614, 2021 - arxiv.org
transformation follows each feature extractor and then all the … of continual learning due to
the addition of all old feature … learned feature extractor and only the pruned feature extractors …

Preserving linear separability in continual learning by backward feature projection

Q Gu, D Shim, F Shkurti - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
… Therefore, we propose to learn a linear transformation that projects the new feature
space back to the old one and in the following section, we show it can achieve both goals. …

[PDF][PDF] Does continual learning= catastrophic forgetting

A Thai, S Stojanov, I Rehg, JM Rehg - arXiv preprint arXiv …, 2021 - academia.edu
… study continual learning for reconstructionstyle tasks such as these. We also examine the
performance of continual … is used as applying an affine transformation on the output of the point …