A comprehensive review of binary neural network
Deep learning (DL) has recently changed the development of intelligent systems and is
widely adopted in many real-life applications. Despite their various benefits and potentials …
widely adopted in many real-life applications. Despite their various benefits and potentials …
A systematic literature review on binary neural networks
R Sayed, H Azmi, H Shawkey, AH Khalil… - IEEE Access, 2023 - ieeexplore.ieee.org
This paper presents an extensive literature review on Binary Neural Network (BNN). BNN
utilizes binary weights and activation function parameters to substitute the full-precision …
utilizes binary weights and activation function parameters to substitute the full-precision …
A survey of quantization methods for efficient neural network inference
This chapter provides approaches to the problem of quantizing the numerical values in deep
Neural Network computations, covering the advantages/disadvantages of current methods …
Neural Network computations, covering the advantages/disadvantages of current methods …
Binary neural networks: A survey
The binary neural network, largely saving the storage and computation, serves as a
promising technique for deploying deep models on resource-limited devices. However, the …
promising technique for deploying deep models on resource-limited devices. However, the …
Reactnet: Towards precise binary neural network with generalized activation functions
In this paper, we propose several ideas for enhancing a binary network to close its accuracy
gap from real-valued networks without incurring any additional computational cost. We first …
gap from real-valued networks without incurring any additional computational cost. We first …
Forward and backward information retention for accurate binary neural networks
Weight and activation binarization is an effective approach to deep neural network
compression and can accelerate the inference by leveraging bitwise operations. Although …
compression and can accelerate the inference by leveraging bitwise operations. Although …
Training binary neural networks with real-to-binary convolutions
This paper shows how to train binary networks to within a few percent points ($\sim 3-5\% $)
of the full precision counterpart. We first show how to build a strong baseline, which already …
of the full precision counterpart. We first show how to build a strong baseline, which already …
How do adam and training strategies help bnns optimization
Abstract The best performing Binary Neural Networks (BNNs) are usually attained using
Adam optimization and its multi-step training variants. However, to the best of our …
Adam optimization and its multi-step training variants. However, to the best of our …
Recu: Reviving the dead weights in binary neural networks
Binary neural networks (BNNs) have received increasing attention due to their superior
reductions of computation and memory. Most existing works focus on either lessening the …
reductions of computation and memory. Most existing works focus on either lessening the …
Learning channel-wise interactions for binary convolutional neural networks
In this paper, we propose a channel-wise interaction based binary convolutional neural
network learning method (CI-BCNN) for efficient inference. Conventional methods apply …
network learning method (CI-BCNN) for efficient inference. Conventional methods apply …