Generative replay with feedback connections as a general strategy for continual learning

GM Van de Ven, AS Tolias - arXiv preprint arXiv:1809.10635, 2018 - arxiv.org
A major obstacle to developing artificial intelligence applications capable of true lifelong
learning is that artificial neural networks quickly or catastrophically forget previously learned …

Three scenarios for continual learning

GM Van de Ven, AS Tolias - arXiv preprint arXiv:1904.07734, 2019 - arxiv.org
Standard artificial neural networks suffer from the well-known issue of catastrophic
forgetting, making continual or lifelong learning difficult for machine learning. In recent years …

Brain-inspired replay for continual learning with artificial neural networks

GM Van de Ven, HT Siegelmann, AS Tolias - Nature communications, 2020 - nature.com
Artificial neural networks suffer from catastrophic forgetting. Unlike humans, when these
networks are trained on something new, they rapidly forget what was learned before. In the …

Online continual learning with maximal interfered retrieval

R Aljundi, E Belilovsky, T Tuytelaars… - Advances in neural …, 2019 - proceedings.neurips.cc
Continual learning, the setting where a learning agent is faced with a never-ending stream
of data, continues to be a great challenge for modern machine learning systems. In …

Distilled replay: Overcoming forgetting through synthetic samples

A Rosasco, A Carta, A Cossu, V Lomonaco… - … Workshop on Continual …, 2021 - Springer
Abstract Replay strategies are Continual Learning techniques which mitigate catastrophic
forgetting by keeping a buffer of patterns from previous experiences, which are interleaved …

Online class-incremental continual learning with adversarial shapley value

D Shim, Z Mai, J Jeong, S Sanner, H Kim… - Proceedings of the AAAI …, 2021 - ojs.aaai.org
As image-based deep learning becomes pervasive on every device, from cell phones to
smart watches, there is a growing need to develop methods that continually learn from data …

Retrospective adversarial replay for continual learning

L Kumari, S Wang, T Zhou… - Advances in neural …, 2022 - proceedings.neurips.cc
Continual learning is an emerging research challenge in machine learning that addresses
the problem where models quickly fit the most recently trained-on data but suffer from …

Bns: Building network structures dynamically for continual learning

Q Qin, W Hu, H Peng, D Zhao… - Advances in Neural …, 2021 - proceedings.neurips.cc
Continual learning (CL) of a sequence of tasks is often accompanied with the catastrophic
forgetting (CF) problem. Existing research has achieved remarkable results in overcoming …

Loss decoupling for task-agnostic continual learning

YS Liang, WJ Li - Advances in Neural Information …, 2024 - proceedings.neurips.cc
Continual learning requires the model to learn multiple tasks in a sequential order. To
perform continual learning, the model must possess the abilities to maintain performance on …

Architecture matters in continual learning

SI Mirzadeh, A Chaudhry, D Yin, T Nguyen… - arXiv preprint arXiv …, 2022 - arxiv.org
A large body of research in continual learning is devoted to overcoming the catastrophic
forgetting of neural networks by designing new algorithms that are robust to the distribution …