Weight-sharing neural architecture search: A battle to shrink the optimization gap

L Xie, X Chen, K Bi, L Wei, Y Xu, L Wang… - ACM Computing …, 2021 - dl.acm.org
Neural architecture search (NAS) has attracted increasing attention. In recent years,
individual search methods have been replaced by weight-sharing search methods for higher …

Rmm: Reinforced memory management for class-incremental learning

Y Liu, B Schiele, Q Sun - Advances in Neural Information …, 2021 - proceedings.neurips.cc
Abstract Class-Incremental Learning (CIL)[38] trains classifiers under a strict memory
budget: in each incremental phase, learning is done for new data, most of which is …

Architecture matters in continual learning

SI Mirzadeh, A Chaudhry, D Yin, T Nguyen… - arXiv preprint arXiv …, 2022 - arxiv.org
A large body of research in continual learning is devoted to overcoming the catastrophic
forgetting of neural networks by designing new algorithms that are robust to the distribution …

Memory-efficient class-incremental learning for image classification

H Zhao, H Wang, Y Fu, F Wu, X Li - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
With the memory-resource-limited constraints, class-incremental learning (CIL) usually
suffers from the “catastrophic forgetting” problem when updating the joint classification …

Class-incremental exemplar compression for class-incremental learning

Z Luo, Y Liu, B Schiele, Q Sun - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Exemplar-based class-incremental learning (CIL) finetunes the model with all samples of
new classes but few-shot exemplars of old classes in each incremental phase, where the" …

Self-growing binary activation network: A novel deep learning model with dynamic architecture

Z Zhang, Y Chen, C Zhou - IEEE Transactions on Neural …, 2022 - ieeexplore.ieee.org
For a deep learning model, the network architecture is crucial as a model with inappropriate
architecture often suffers from performance degradation or parameter redundancy. However …

SATHUR: Self Augmenting Task Hallucinal Unified Representation for Generalized Class Incremental Learning

S Kanagarajah, T Ambegoda… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Class Incremental Learning (CIL) is inspired by the human ability to learn new
classes without forgetting previous ones. CIL becomes more challenging in real-world …

Advisil-a class-incremental learning advisor

E Feillet, G Petit, A Popescu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recent class-incremental learning methods combine deep neural architectures and learning
algorithms to handle streaming data under memory and computational constraints. The …

Incremental learning with differentiable architecture and forgetting search

JS Smith, Z Seymour, HP Chiu - 2022 International Joint …, 2022 - ieeexplore.ieee.org
As progress is made on training machine learning models on incrementally expanding
classification tasks (ie, incremental learning), a next step is to translate this progress to …

Exploring the Intersection between Neural Architecture Search and Continual Learning

M Shahawy, E Benkhelifa, D White - arXiv preprint arXiv:2206.05625, 2022 - arxiv.org
Despite the significant advances achieved in Artificial Neural Networks (ANNs), their design
process remains notoriously tedious, depending primarily on intuition, experience and trial …