[PDF][PDF] Continual learning: A comparative study on how to defy forgetting in classification tasks

M De Lange, R Aljundi, M Masana… - arXiv preprint arXiv …, 2019 - homes.esat.kuleuven.be
… a network that can continually accumulate knowledge over different tasks without the need
… to alleviate forgetting. We focus on task-incremental classification, where tasks arrive in a …

Continual learning: A review of techniques, challenges and future directions

B Wickramasinghe, G Saha… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
… We introduce another category to the existing taxonomy of CL, the emerging concept of …
while minimizing forgetting and preserving client privacy is a challenge unique to distributed …

Achieving forgetting prevention and knowledge transfer in continual learning

Z Ke, B Liu, N Ma, H Xu, L Shu - Advances in Neural …, 2021 - proceedings.neurips.cc
… for the task in the network can be applied to classify the test … is class continual learning,
which does not provide the task id … Task-CL setting, we don’t want the training of the new task to …

Pretrained language model in continual learning: A comparative study

T Wu, M Caccia, Z Li, YF Li, G Qi… - … on Learning …, 2022 - research.monash.edu
… possible reasons to catastrophic forgetting on BERT. (1) The … Hence, we can use the mean
classification accuracy as a … during continual learning, where T is the number of learned tasks, …

More classifiers, less forgetting: A generic multi-classifier paradigm for incremental learning

Y Liu, S Parisot, G Slabaugh, X Jia, A Leonardis… - Computer Vision–ECCV …, 2020 - Springer
… The major challenge in incremental learning is the so-called … top-1 classification accuracy.
In addition, we report the … forgetting across tasks and datasets. Through additional component …

Understanding the role of training regimes in continual learning

SI Mirzadeh, M Farajtabar, R Pascanu… - Advances in …, 2020 - proceedings.neurips.cc
learning field, continual learning has gained more attention since the catastrophic forgetting
problem poses a critical challenge for … forgetting, we provide a comparison of the first task’s …

In defense of the learning without forgetting for task incremental learning

G Oren, L Wolf - Proceedings of the IEEE/CVF International …, 2021 - openaccess.thecvf.com
… on the road for continual learning systems, which are pre… set of methods have been presented
for overcoming this challenge. … do not well represent modern classification tasks. The two-…

Continual learning of a mixed sequence of similar and dissimilar tasks

Z Ke, B Liu, X Huang - Advances in neural information …, 2020 - proceedings.neurips.cc
… This paper proposes a novel TCL model called CAT (Continual learning with forgetting
3For example, one task is to classify fish and non-fish, and another task is to classify different …

Gdumb: A simple approach that questions our progress in continual learning

A Prabhu, PHS Torr, PK Dokania - … , Glasgow, UK, August 23–28, 2020 …, 2020 - Springer
… for the Continual Learning (CL) problem for classification—a learning task where a stream
… , they are prone to the phenomenon called catastrophic forgetting [1, 2]. Significant attention …

Continual learning with attentive recurrent neural networks for temporal data classification

SY Yin, Y Huang, TY Chang, SF Chang, VS Tseng - Neural Networks, 2023 - Elsevier
continual learning by allowing a model to continuously learn on temporal data. To solve the
forgetting problem of learning temporal data in task incremental scenarios, in this research, …