Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and …

JL McClelland, BL McNaughton… - Psychological review, 1995 - psycnet.apa.org
Damage to the hippocampal system disrupts recent memory but leaves remote memory
intact. The account presented here suggests that memories are first stored via synaptic …

Catastrophic forgetting in connectionist networks

RM French - Trends in cognitive sciences, 1999 - cell.com
All natural cognitive systems, and, in particular, our own, gradually forget previously learned
information. Plausible models of human cognition should therefore exhibit similar patterns of …

A continual learning survey: Defying forgetting in classification tasks

M De Lange, R Aljundi, M Masana… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Artificial neural networks thrive in solving the classification problem for a particular rigid task,
acquiring knowledge through generalized learning behaviour from a distinct training phase …

Online continual learning with maximal interfered retrieval

R Aljundi, E Belilovsky, T Tuytelaars… - Advances in neural …, 2019 - proceedings.neurips.cc
Continual learning, the setting where a learning agent is faced with a never-ending stream
of data, continues to be a great challenge for modern machine learning systems. In …

[PDF][PDF] Continual learning: A comparative study on how to defy forgetting in classification tasks

M De Lange, R Aljundi, M Masana… - arXiv preprint arXiv …, 2019 - homes.esat.kuleuven.be
Artificial neural networks thrive in solving the classification problem for a particular rigid task,
where the network resembles a static entity of knowledge, acquired through generalized …

[HTML][HTML] A wholistic view of continual learning with deep neural networks: Forgotten lessons and the bridge to active and open world learning

M Mundt, Y Hong, I Pliushch, V Ramesh - Neural Networks, 2023 - Elsevier
Current deep learning methods are regarded as favorable if they empirically perform well on
dedicated test sets. This mentality is seamlessly reflected in the resurfacing area of continual …

Incremental learning algorithms and applications

A Gepperth, B Hammer - European symposium on artificial neural …, 2016 - hal.science
Incremental learning refers to learning from streaming data, which arrive over time, with
limited memory resources and, ideally, without sacrificing model accuracy. This setting fits …

The stability-plasticity dilemma: Investigating the continuum from catastrophic forgetting to age-limited learning effects

M Mermillod, A Bugaiska, P Bonin - Frontiers in psychology, 2013 - frontiersin.org
The stability-plasticity dilemma is a wellknow constraint for artificial and biological neural
systems. The basic idea is that learning in a parallel and distributed system requires …

Catastrophic forgetting, rehearsal and pseudorehearsal

A Robins - Connection Science, 1995 - Taylor & Francis
This paper reviews the problem of catastrophic forgetting (the loss or disruption of previously
learned information when new information is learned) in neural networks, and explores …

DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction

NK Kasabov, Q Song - IEEE transactions on Fuzzy Systems, 2002 - ieeexplore.ieee.org
This paper introduces a new type of fuzzy inference systems, denoted as dynamic evolving
neural-fuzzy inference system (DENFIS), for adaptive online and offline learning, and their …