Lifelong machine learning with deep streaming linear discriminant analysis
When an agent acquires new information, ideally it would immediately be capable of using
that information to understand its environment. This is not possible using conventional deep …
that information to understand its environment. This is not possible using conventional deep …
Rehearsal revealed: The limits and merits of revisiting samples in continual learning
E Verwimp, M De Lange… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Learning from non-stationary data streams and overcoming catastrophic forgetting still
poses a serious challenge for machine learning research. Rather than aiming to improve …
poses a serious challenge for machine learning research. Rather than aiming to improve …
End-to-end incremental learning
Although deep learning approaches have stood out in recent years due to their state-of-the-
art results, they continue to suffer from catastrophic forgetting, a dramatic decrease in overall …
art results, they continue to suffer from catastrophic forgetting, a dramatic decrease in overall …
Learning a unified classifier incrementally via rebalancing
Conventionally, deep neural networks are trained offline, relying on a large dataset
prepared in advance. This paradigm is often challenged in real-world applications, eg online …
prepared in advance. This paradigm is often challenged in real-world applications, eg online …
Continual learning on noisy data streams via self-purified replay
Continually learning in the real world must overcome many challenges, among which noisy
labels are a common and inevitable issue. In this work, we present a replay-based continual …
labels are a common and inevitable issue. In this work, we present a replay-based continual …
Online continual learning without the storage constraint
Traditional online continual learning (OCL) research has primarily focused on mitigating
catastrophic forgetting with fixed and limited storage allocation throughout an agent's …
catastrophic forgetting with fixed and limited storage allocation throughout an agent's …
Ddgr: Continual learning with deep diffusion-based generative replay
R Gao, W Liu - International Conference on Machine …, 2023 - proceedings.mlr.press
Popular deep-learning models in the field of image classification suffer from catastrophic
forgetting—models will forget previously acquired skills when learning new ones …
forgetting—models will forget previously acquired skills when learning new ones …
Online continual learning with maximal interfered retrieval
Continual learning, the setting where a learning agent is faced with a never-ending stream
of data, continues to be a great challenge for modern machine learning systems. In …
of data, continues to be a great challenge for modern machine learning systems. In …
Online continual learning under extreme memory constraints
Continual Learning (CL) aims to develop agents emulating the human ability to sequentially
learn new tasks while being able to retain knowledge obtained from past experiences. In this …
learn new tasks while being able to retain knowledge obtained from past experiences. In this …
Overcoming catastrophic forgetting with unlabeled data in the wild
Lifelong learning with deep neural networks is well-known to suffer from catastrophic
forgetting: the performance on previous tasks drastically degrades when learning a new …
forgetting: the performance on previous tasks drastically degrades when learning a new …