Lifelong machine learning with deep streaming linear discriminant analysis

TL Hayes, C Kanan - … of the IEEE/CVF conference on …, 2020 - openaccess.thecvf.com
When an agent acquires new information, ideally it would immediately be capable of using
that information to understand its environment. This is not possible using conventional deep …

Rehearsal revealed: The limits and merits of revisiting samples in continual learning

E Verwimp, M De Lange… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Learning from non-stationary data streams and overcoming catastrophic forgetting still
poses a serious challenge for machine learning research. Rather than aiming to improve …

End-to-end incremental learning

FM Castro, MJ Marín-Jiménez, N Guil… - Proceedings of the …, 2018 - openaccess.thecvf.com
Although deep learning approaches have stood out in recent years due to their state-of-the-
art results, they continue to suffer from catastrophic forgetting, a dramatic decrease in overall …

Learning a unified classifier incrementally via rebalancing

S Hou, X Pan, CC Loy, Z Wang… - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
Conventionally, deep neural networks are trained offline, relying on a large dataset
prepared in advance. This paradigm is often challenged in real-world applications, eg online …

Continual learning on noisy data streams via self-purified replay

CD Kim, J Jeong, S Moon… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Continually learning in the real world must overcome many challenges, among which noisy
labels are a common and inevitable issue. In this work, we present a replay-based continual …

Online continual learning without the storage constraint

A Prabhu, Z Cai, P Dokania, P Torr, V Koltun… - arXiv preprint arXiv …, 2023 - arxiv.org
Traditional online continual learning (OCL) research has primarily focused on mitigating
catastrophic forgetting with fixed and limited storage allocation throughout an agent's …

Ddgr: Continual learning with deep diffusion-based generative replay

R Gao, W Liu - International Conference on Machine …, 2023 - proceedings.mlr.press
Popular deep-learning models in the field of image classification suffer from catastrophic
forgetting—models will forget previously acquired skills when learning new ones …

Online continual learning with maximal interfered retrieval

R Aljundi, E Belilovsky, T Tuytelaars… - Advances in neural …, 2019 - proceedings.neurips.cc
Continual learning, the setting where a learning agent is faced with a never-ending stream
of data, continues to be a great challenge for modern machine learning systems. In …

Online continual learning under extreme memory constraints

E Fini, S Lathuiliere, E Sangineto, M Nabi… - Computer Vision–ECCV …, 2020 - Springer
Continual Learning (CL) aims to develop agents emulating the human ability to sequentially
learn new tasks while being able to retain knowledge obtained from past experiences. In this …

Overcoming catastrophic forgetting with unlabeled data in the wild

K Lee, K Lee, J Shin, H Lee - Proceedings of the IEEE/CVF …, 2019 - openaccess.thecvf.com
Lifelong learning with deep neural networks is well-known to suffer from catastrophic
forgetting: the performance on previous tasks drastically degrades when learning a new …