[PDF][PDF] Open-environment machine learning

ZH Zhou - National Science Review, 2022 - academic.oup.com
Conventional machine learning studies generally assume close-environment scenarios
where important factors of the learning process hold invariant. With the great success of …

Continual learning of natural language processing tasks: A survey

Z Ke, B Liu - arXiv preprint arXiv:2211.12701, 2022 - arxiv.org
Continual learning (CL) is a learning paradigm that emulates the human capability of
learning and accumulating knowledge continually without forgetting the previously learned …

Three types of incremental learning

GM Van de Ven, T Tuytelaars, AS Tolias - Nature Machine Intelligence, 2022 - nature.com
Incrementally learning new information from a non-stationary stream of data, referred to as
'continual learning', is a key feature of natural intelligence, but a challenging problem for …

Dualprompt: Complementary prompting for rehearsal-free continual learning

Z Wang, Z Zhang, S Ebrahimi, R Sun, H Zhang… - … on Computer Vision, 2022 - Springer
Continual learning aims to enable a single model to learn a sequence of tasks without
catastrophic forgetting. Top-performing methods usually require a rehearsal buffer to store …

Foster: Feature boosting and compression for class-incremental learning

FY Wang, DW Zhou, HJ Ye, DC Zhan - European conference on computer …, 2022 - Springer
The ability to learn new concepts continually is necessary in this ever-changing world.
However, deep neural networks suffer from catastrophic forgetting when learning new …

Deep class-incremental learning: A survey

DW Zhou, QW Wang, ZH Qi, HJ Ye, DC Zhan… - arXiv preprint arXiv …, 2023 - arxiv.org
Deep models, eg, CNNs and Vision Transformers, have achieved impressive achievements
in many vision tasks in the closed world. However, novel classes emerge from time to time in …

A continual learning survey: Defying forgetting in classification tasks

M De Lange, R Aljundi, M Masana… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Artificial neural networks thrive in solving the classification problem for a particular rigid task,
acquiring knowledge through generalized learning behaviour from a distinct training phase …

Computationally budgeted continual learning: What does matter?

A Prabhu, HA Al Kader Hammoud… - Proceedings of the …, 2023 - openaccess.thecvf.com
Continual Learning (CL) aims to sequentially train models on streams of incoming data that
vary in distribution by preserving previous knowledge while adapting to new data. Current …

Avalanche: an end-to-end library for continual learning

V Lomonaco, L Pellegrini, A Cossu… - Proceedings of the …, 2021 - openaccess.thecvf.com
Learning continually from non-stationary data streams is a long-standing goal and a
challenging problem in machine learning. Recently, we have witnessed a renewed and fast …

Supervised contrastive replay: Revisiting the nearest class mean classifier in online class-incremental continual learning

Z Mai, R Li, H Kim, S Sanner - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Online class-incremental continual learning (CL) studies the problem of learning new
classes continually from an online non-stationary data stream, intending to adapt to new …