A comprehensive survey of continual learning: theory, method and application
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …
Dataset distillation: A comprehensive review
Recent success of deep learning is largely attributed to the sheer amount of data used for
training deep neural networks. Despite the unprecedented success, the massive data …
training deep neural networks. Despite the unprecedented success, the massive data …
Dualprompt: Complementary prompting for rehearsal-free continual learning
Continual learning aims to enable a single model to learn a sequence of tasks without
catastrophic forgetting. Top-performing methods usually require a rehearsal buffer to store …
catastrophic forgetting. Top-performing methods usually require a rehearsal buffer to store …
Learning to prompt for continual learning
The mainstream paradigm behind continual learning has been to adapt the model
parameters to non-stationary data distributions, where catastrophic forgetting is the central …
parameters to non-stationary data distributions, where catastrophic forgetting is the central …
Class-incremental learning by knowledge distillation with adaptive feature consolidation
We present a novel class incremental learning approach based on deep neural networks,
which continually learns new tasks with limited memory for storing examples in the previous …
which continually learns new tasks with limited memory for storing examples in the previous …
S-prompts learning with pre-trained transformers: An occam's razor for domain incremental learning
State-of-the-art deep neural networks are still struggling to address the catastrophic
forgetting problem in continual learning. In this paper, we propose one simple paradigm …
forgetting problem in continual learning. In this paper, we propose one simple paradigm …
Towards open world object detection
Humans have a natural instinct to identify unknown object instances in their environments.
The intrinsic curiosity about these unknown instances aids in learning about them, when the …
The intrinsic curiosity about these unknown instances aids in learning about them, when the …
Prototype augmentation and self-supervision for incremental learning
Despite the impressive performance in many individual tasks, deep neural networks suffer
from catastrophic forgetting when learning new tasks incrementally. Recently, various …
from catastrophic forgetting when learning new tasks incrementally. Recently, various …
Dataset condensation with distribution matching
Computational cost of training state-of-the-art deep models in many learning problems is
rapidly increasing due to more sophisticated models and larger datasets. A recent promising …
rapidly increasing due to more sophisticated models and larger datasets. A recent promising …
Class-incremental learning: survey and performance evaluation on image classification
For future learning systems, incremental learning is desirable because it allows for: efficient
resource usage by eliminating the need to retrain from scratch at the arrival of new data; …
resource usage by eliminating the need to retrain from scratch at the arrival of new data; …