Resmlp: Feedforward networks for image classification with data-efficient training

H Touvron, P Bojanowski, M Caron… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
We present ResMLP, an architecture built entirely upon multi-layer perceptrons for image
classification. It is a simple residual network that alternates (i) a linear layer in which image …

Bag of tricks for image classification with convolutional neural networks

T He, Z Zhang, H Zhang, Z Zhang… - Proceedings of the …, 2019 - openaccess.thecvf.com
Much of the recent progress made in image classification research can be credited to
training procedure refinements, such as changes in data augmentations and optimization …

Hard-attention for scalable image classification

A Papadopoulos, P Korus… - Advances in Neural …, 2021 - proceedings.neurips.cc
Can we leverage high-resolution information without the unsustainable quadratic complexity
to input scale? We propose Traversal Network (TNet), a novel multi-scale hard-attention …

Gated convolutional networks with hybrid connectivity for image classification

C Yang, Z An, H Zhu, X Hu, K Zhang, K Xu, C Li… - Proceedings of the AAAI …, 2020 - aaai.org
We propose a simple yet effective method to reduce the redundancy of DenseNet by
substantially decreasing the number of stacked modules by replacing the original bottleneck …

Augmenting supervised neural networks with unsupervised objectives for large-scale image classification

Y Zhang, K Lee, H Lee - International conference on …, 2016 - proceedings.mlr.press
Unsupervised learning and supervised learning are key research topics in deep learning.
However, as high-capacity supervised neural networks trained with a large amount of labels …

Learn to pay attention

S Jetley, NA Lord, N Lee, PHS Torr - arXiv preprint arXiv:1804.02391, 2018 - arxiv.org
We propose an end-to-end-trainable attention module for convolutional neural network
(CNN) architectures built for image classification. The module takes as input the 2D feature …

Squeeze-and-excitation wide residual networks in image classification

X Zhong, O Gong, W Huang, L Li… - 2019 IEEE International …, 2019 - ieeexplore.ieee.org
The depth and width of the network have been investigated to influence the performance of
image classification during the resent research. Wide residual networks (WRNs) have …

IamNN: Iterative and adaptive mobile neural network for efficient image classification

S Leroux, P Molchanov, P Simoens, B Dhoedt… - arXiv preprint arXiv …, 2018 - arxiv.org
Deep residual networks (ResNets) made a recent breakthrough in deep learning. The core
idea of ResNets is to have shortcut connections between layers that allow the network to be …

Multi-scale dense networks for resource efficient image classification

G Huang, D Chen, T Li, F Wu… - arXiv preprint arXiv …, 2017 - arxiv.org
In this paper we investigate image classification with computational resource limits at test
time. Two such settings are: 1. anytime classification, where the network's prediction for a …

Error-driven incremental learning in deep convolutional neural network for large-scale image classification

T Xiao, J Zhang, K Yang, Y Peng, Z Zhang - Proceedings of the 22nd …, 2014 - dl.acm.org
Supervised learning using deep convolutional neural network has shown its promise in
large-scale image classification task. As a building block, it is now well positioned to be part …