Online continual learning through mutual information maximization

Y Guo, B Liu, D Zhao - International conference on machine …, 2022 - proceedings.mlr.press
This paper proposed a new online continual learning approach called OCM based on
mutual information (MI) maximization. It achieves two objectives that are critical in dealing …

A theoretical study on solving continual learning

G Kim, C Xiao, T Konishi, Z Ke… - Advances in neural …, 2022 - proceedings.neurips.cc
Continual learning (CL) learns a sequence of tasks incrementally. There are two popular CL
settings, class incremental learning (CIL) and task incremental learning (TIL). A major …

A multi-head model for continual learning via out-of-distribution replay

G Kim, B Liu, Z Ke - Conference on Lifelong Learning …, 2022 - proceedings.mlr.press
This paper studies class incremental learning (CIL) of continual learning (CL). Many
approaches have been proposed to deal with catastrophic forgetting (CF) in CIL. Most …

Learning Equi-angular Representations for Online Continual Learning

M Seo, H Koh, W Jeung, M Lee, S Kim… - Proceedings of the …, 2024 - openaccess.thecvf.com
Online continual learning suffers from an underfitted solution due to insufficient training for
prompt model updates (eg single-epoch training). To address the challenge we propose an …

A survey on out-of-distribution detection in nlp

H Lang, Y Zheng, Y Li, J Sun, F Huang, Y Li - arXiv preprint arXiv …, 2023 - arxiv.org
Out-of-distribution (OOD) detection is essential for the reliable and safe deployment of
machine learning systems in the real world. Great progress has been made over the past …

Continual Evidential Deep Learning for Out-of-Distribution Detection

E Aguilar, B Raducanu, P Radeva… - Proceedings of the …, 2023 - openaccess.thecvf.com
Uncertainty-based deep learning models have attracted a great deal of interest for their
ability to provide accurate and reliable predictions. Evidential deep learning stands out …

Open-world continual learning: Unifying novelty detection and continual learning

G Kim, C Xiao, T Konishi, Z Ke, B Liu - arXiv preprint arXiv:2304.10038, 2023 - arxiv.org
As AI agents are increasingly used in the real open world with unknowns or novelties, they
need the ability to (1) recognize objects that (i) they have learned and (ii) detect items that …

Hierarchical task-incremental learning with feature-space initialization inspired by neural collapse

Q Zhou, X Xiang, J Ma - Neural Processing Letters, 2023 - Springer
Incremental learning models need to update the categories and their conceptual
understanding over time. The current research has placed more emphasis on learning new …

Prediction error-based classification for class-incremental learning

M Zając, T Tuytelaars, GM van de Ven - arXiv preprint arXiv:2305.18806, 2023 - arxiv.org
Class-incremental learning (CIL) is a particularly challenging variant of continual learning,
where the goal is to learn to discriminate between all classes presented in an incremental …

Open-World Continual Learning: A Framework

S Mazumder, B Liu - Lifelong and Continual Learning Dialogue Systems, 2024 - Springer
As more and more AI agents are used in practice, we need to think about how to make these
agents fully autonomous so that they can (1) learn by themselves continually in a self …