A domain-agnostic approach for characterization of lifelong learning systems

MM Baker, A New, M Aguilar-Simon, Z Al-Halah… - Neural Networks, 2023 - Elsevier
Despite the advancement of machine learning techniques in recent years, state-of-the-art
systems lack robustness to “real world” events, where the input distributions and tasks …

Assessment of catastrophic forgetting in continual credit card fraud detection

B Lebichot, W Siblini, GM Paldino, YA Le Borgne… - Expert Systems with …, 2024 - Elsevier
The volume of e-commerce continues to increase year after year. Buying goods on the
internet is easy and practical, and took a huge boost during the lockdowns of the Covid …

Fixed design analysis of regularization-based continual learning

H Li, J Wu, V Braverman - Conference on Lifelong Learning …, 2023 - proceedings.mlr.press
We consider a continual learning (CL) problem with two linear regression tasks in the fixed
design setting, where the feature vectors are assumed fixed and the labels are assumed to …

Accelerating batch active learning using continual learning techniques

A Das, G Bhatt, M Bhalerao, V Gao, R Yang… - arXiv preprint arXiv …, 2023 - arxiv.org
A major problem with Active Learning (AL) is high training costs since models are typically
retrained from scratch after every query round. We start by demonstrating that standard AL …

Hierarchically structured task-agnostic continual learning

H Hihn, DA Braun - Machine Learning, 2023 - Springer
One notable weakness of current machine learning algorithms is the poor ability of models
to solve new problems without forgetting previously acquired knowledge. The Continual …

Multi-agent lifelong implicit neural learning

S Kolouri, A Abbasi, SA Koohpayegani… - IEEE Signal …, 2023 - ieeexplore.ieee.org
Implicit neural representations (INRs) have emerged as powerful tools for the continuous
representation of signals, finding applications in imaging, computer graphics, and signal …

Is multi-task learning an upper bound for continual learning?

Z Wu, H Tran, H Pirsiavash… - ICASSP 2023-2023 IEEE …, 2023 - ieeexplore.ieee.org
Continual learning and multi-task learning are commonly used machine learning techniques
for learning from multiple tasks. However, existing literature assumes multi-task learning as …

Prompt-based conservation learning for multi-hop question answering

Z Deng, Y Zhu, Y Chen, Q Qi, M Witbrock… - arXiv preprint arXiv …, 2022 - arxiv.org
Multi-hop question answering (QA) requires reasoning over multiple documents to answer a
complex question and provide interpretable supporting evidence. However, providing …

Provable continual learning via sketched jacobian approximations

R Heckel - … Conference on Artificial Intelligence and Statistics, 2022 - proceedings.mlr.press
An important problem in machine learning is the ability to learn tasks in a sequential
manner. If trained with standard first-order methods most models forget previously learned …

Continual Active Learning

AM Das, G Bhatt, MM Bhalerao, VR Gao, R Yang… - 2023 - openreview.net
While active learning (AL) improves the labeling efficiency of machine learning (by allowing
models to query the labels of data samples), a major problem is that compute efficiency is …