Revisiting class-incremental learning with pre-trained models: Generalizability and adaptivity are all you need

DW Zhou, ZW Cai, HJ Ye, DC Zhan, Z Liu - arXiv preprint arXiv …, 2023 - arxiv.org
Class-incremental learning (CIL) aims to adapt to emerging new classes without forgetting
old ones. Traditional CIL models are trained from scratch to continually acquire knowledge …

Class-incremental learning: A survey

DW Zhou, QW Wang, ZH Qi, HJ Ye… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Deep models, eg, CNNs and Vision Transformers, have achieved impressive achievements
in many vision tasks in the closed world. However, novel classes emerge from time to time in …

Gkeal: Gaussian kernel embedded analytic learning for few-shot class incremental task

H Zhuang, Z Weng, R He, Z Lin… - Proceedings of the …, 2023 - openaccess.thecvf.com
Few-shot class incremental learning (FSCIL) aims to address catastrophic forgetting during
class incremental learning in a few-shot learning setting. In this paper, we approach the …

Expandable subspace ensemble for pre-trained model-based class-incremental learning

DW Zhou, HL Sun, HJ Ye… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Abstract Class-Incremental Learning (CIL) requires a learning system to continually learn
new classes without forgetting. Despite the strong performance of Pre-Trained Models …

Continual learning with pre-trained models: A survey

DW Zhou, HL Sun, J Ning, HJ Ye, DC Zhan - arXiv preprint arXiv …, 2024 - arxiv.org
Nowadays, real-world applications often face streaming data, which requires the learning
system to absorb new knowledge as data evolves. Continual Learning (CL) aims to achieve …

Online Analytic Exemplar-Free Continual Learning with Large Models for Imbalanced Autonomous Driving Task

H Zhuang, D Fang, K Tong, Y Liu… - IEEE Transactions …, 2024 - ieeexplore.ieee.org
In autonomous driving, even a meticulously trained model can encounter failures when
facing unfamiliar scenarios. One of these scenarios can be formulated as an online …

Towards General Industrial Intelligence: A Survey on IIoT-Enhanced Continual Large Models

J Chen, J He, F Chen, Z Lv, J Tang, W Li, Z Liu… - arXiv preprint arXiv …, 2024 - arxiv.org
Currently, most applications in the Industrial Internet of Things (IIoT) still rely on CNN-based
neural networks. Although Transformer-based large models (LMs), including language …

Towards realistic evaluation of industrial continual learning scenarios with an emphasis on energy consumption and computational footprint

V Chavan, P Koch, M Schlüter… - Proceedings of the …, 2023 - openaccess.thecvf.com
Incremental Learning (IL) aims to develop Machine Learning (ML) models that can learn
from continuous streams of data and mitigate catastrophic forgetting. We analyse the current …

Enhancing knowledge transfer for task incremental learning with data-free subnetwork

Q Gao, X Shan, Y Zhang… - Advances in Neural …, 2023 - proceedings.neurips.cc
As there exist competitive subnetworks within a dense network in concert with Lottery Ticket
Hypothesis, we introduce a novel neuron-wise task incremental learning method, namely …

Wave-mamba: Wavelet state space model for ultra-high-definition low-light image enhancement

W Zou, H Gao, W Yang, T Liu - Proceedings of the 32nd ACM …, 2024 - dl.acm.org
Ultra-high-definition (UHD) technology has attracted widespread attention due to its
exceptional visual quality, but it also poses new challenges for low-light image …