[HTML][HTML] Review of image classification algorithms based on convolutional neural networks
L Chen, S Li, Q Bai, J Yang, S Jiang, Y Miao - Remote Sensing, 2021 - mdpi.com
Image classification has always been a hot research direction in the world, and the
emergence of deep learning has promoted the development of this field. Convolutional …
emergence of deep learning has promoted the development of this field. Convolutional …
A survey of accelerator architectures for deep neural networks
Recently, due to the availability of big data and the rapid growth of computing power,
artificial intelligence (AI) has regained tremendous attention and investment. Machine …
artificial intelligence (AI) has regained tremendous attention and investment. Machine …
Sparsity in deep learning: Pruning and growth for efficient inference and training in neural networks
The growing energy and performance costs of deep learning have driven the community to
reduce the size of neural networks by selectively pruning components. Similarly to their …
reduce the size of neural networks by selectively pruning components. Similarly to their …
Pruning and quantization for deep neural network acceleration: A survey
T Liang, J Glossner, L Wang, S Shi, X Zhang - Neurocomputing, 2021 - Elsevier
Deep neural networks have been applied in many applications exhibiting extraordinary
abilities in the field of computer vision. However, complex network architectures challenge …
abilities in the field of computer vision. However, complex network architectures challenge …
Modular deep learning
Transfer learning has recently become the dominant paradigm of machine learning. Pre-
trained models fine-tuned for downstream tasks achieve better performance with fewer …
trained models fine-tuned for downstream tasks achieve better performance with fewer …
Drop an octave: Reducing spatial redundancy in convolutional neural networks with octave convolution
In natural images, information is conveyed at different frequencies where higher frequencies
are usually encoded with fine details and lower frequencies are usually encoded with global …
are usually encoded with fine details and lower frequencies are usually encoded with global …
Visual attention methods in deep learning: An in-depth survey
Inspired by the human cognitive system, attention is a mechanism that imitates the human
cognitive awareness about specific information, amplifying critical details to focus more on …
cognitive awareness about specific information, amplifying critical details to focus more on …
Packnet: Adding multiple tasks to a single network by iterative pruning
A Mallya, S Lazebnik - … of the IEEE conference on Computer …, 2018 - openaccess.thecvf.com
This paper presents a method for adding multiple tasks to a single deep neural network
while avoiding catastrophic forgetting. Inspired by network pruning techniques, we exploit …
while avoiding catastrophic forgetting. Inspired by network pruning techniques, we exploit …
Monarch: Expressive structured matrices for efficient and accurate training
Large neural networks excel in many domains, but they are expensive to train and fine-tune.
A popular approach to reduce their compute or memory requirements is to replace dense …
A popular approach to reduce their compute or memory requirements is to replace dense …
Clip-q: Deep network compression learning by in-parallel pruning-quantization
Deep neural networks enable state-of-the-art accuracy on visual recognition tasks such as
image classification and object detection. However, modern deep networks contain millions …
image classification and object detection. However, modern deep networks contain millions …