Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and …
JL McClelland, BL McNaughton… - Psychological review, 1995 - psycnet.apa.org
Damage to the hippocampal system disrupts recent memory but leaves remote memory
intact. The account presented here suggests that memories are first stored via synaptic …
intact. The account presented here suggests that memories are first stored via synaptic …
Catastrophic forgetting in connectionist networks
RM French - Trends in cognitive sciences, 1999 - cell.com
All natural cognitive systems, and, in particular, our own, gradually forget previously learned
information. Plausible models of human cognition should therefore exhibit similar patterns of …
information. Plausible models of human cognition should therefore exhibit similar patterns of …
A continual learning survey: Defying forgetting in classification tasks
Artificial neural networks thrive in solving the classification problem for a particular rigid task,
acquiring knowledge through generalized learning behaviour from a distinct training phase …
acquiring knowledge through generalized learning behaviour from a distinct training phase …
Online continual learning with maximal interfered retrieval
Continual learning, the setting where a learning agent is faced with a never-ending stream
of data, continues to be a great challenge for modern machine learning systems. In …
of data, continues to be a great challenge for modern machine learning systems. In …
[PDF][PDF] Continual learning: A comparative study on how to defy forgetting in classification tasks
Artificial neural networks thrive in solving the classification problem for a particular rigid task,
where the network resembles a static entity of knowledge, acquired through generalized …
where the network resembles a static entity of knowledge, acquired through generalized …
[HTML][HTML] A wholistic view of continual learning with deep neural networks: Forgotten lessons and the bridge to active and open world learning
Current deep learning methods are regarded as favorable if they empirically perform well on
dedicated test sets. This mentality is seamlessly reflected in the resurfacing area of continual …
dedicated test sets. This mentality is seamlessly reflected in the resurfacing area of continual …
Incremental learning algorithms and applications
A Gepperth, B Hammer - European symposium on artificial neural …, 2016 - hal.science
Incremental learning refers to learning from streaming data, which arrive over time, with
limited memory resources and, ideally, without sacrificing model accuracy. This setting fits …
limited memory resources and, ideally, without sacrificing model accuracy. This setting fits …
The stability-plasticity dilemma: Investigating the continuum from catastrophic forgetting to age-limited learning effects
M Mermillod, A Bugaiska, P Bonin - Frontiers in psychology, 2013 - frontiersin.org
The stability-plasticity dilemma is a wellknow constraint for artificial and biological neural
systems. The basic idea is that learning in a parallel and distributed system requires …
systems. The basic idea is that learning in a parallel and distributed system requires …
Catastrophic forgetting, rehearsal and pseudorehearsal
A Robins - Connection Science, 1995 - Taylor & Francis
This paper reviews the problem of catastrophic forgetting (the loss or disruption of previously
learned information when new information is learned) in neural networks, and explores …
learned information when new information is learned) in neural networks, and explores …
DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction
NK Kasabov, Q Song - IEEE transactions on Fuzzy Systems, 2002 - ieeexplore.ieee.org
This paper introduces a new type of fuzzy inference systems, denoted as dynamic evolving
neural-fuzzy inference system (DENFIS), for adaptive online and offline learning, and their …
neural-fuzzy inference system (DENFIS), for adaptive online and offline learning, and their …