Explainable deep learning for efficient and robust pattern recognition: A survey of recent developments
Deep learning has recently achieved great success in many visual recognition tasks.
However, the deep neural networks (DNNs) are often perceived as black-boxes, making …
However, the deep neural networks (DNNs) are often perceived as black-boxes, making …
Infrared small target segmentation networks: A survey
Fast and robust small target detection is one of the key technologies in the infrared (IR)
search and tracking systems. With the development of deep learning, there are many data …
search and tracking systems. With the development of deep learning, there are many data …
Gpt3. int8 (): 8-bit matrix multiplication for transformers at scale
Large language models have been widely adopted but require significant GPU memory for
inference. We develop a procedure for Int8 matrix multiplication for feed-forward and …
inference. We develop a procedure for Int8 matrix multiplication for feed-forward and …
A survey of quantization methods for efficient neural network inference
This chapter provides approaches to the problem of quantizing the numerical values in deep
Neural Network computations, covering the advantages/disadvantages of current methods …
Neural Network computations, covering the advantages/disadvantages of current methods …
Pruning and quantization for deep neural network acceleration: A survey
T Liang, J Glossner, L Wang, S Shi, X Zhang - Neurocomputing, 2021 - Elsevier
Deep neural networks have been applied in many applications exhibiting extraordinary
abilities in the field of computer vision. However, complex network architectures challenge …
abilities in the field of computer vision. However, complex network architectures challenge …
[HTML][HTML] Green IoT and edge AI as key technological enablers for a sustainable digital transition towards a smart circular economy: An industry 5.0 use case
Internet of Things (IoT) can help to pave the way to the circular economy and to a more
sustainable world by enabling the digitalization of many operations and processes, such as …
sustainable world by enabling the digitalization of many operations and processes, such as …
Structured pruning for deep convolutional neural networks: A survey
The remarkable performance of deep Convolutional neural networks (CNNs) is generally
attributed to their deeper and wider architectures, which can come with significant …
attributed to their deeper and wider architectures, which can come with significant …
8-bit optimizers via block-wise quantization
Stateful optimizers maintain gradient statistics over time, eg, the exponentially smoothed
sum (SGD with momentum) or squared sum (Adam) of past gradient values. This state can …
sum (SGD with momentum) or squared sum (Adam) of past gradient values. This state can …
Dual attention suppression attack: Generate adversarial camouflage in physical world
Deep learning models are vulnerable to adversarial examples. As a more threatening type
for practical deep learning systems, physical adversarial examples have received extensive …
for practical deep learning systems, physical adversarial examples have received extensive …
Forward and backward information retention for accurate binary neural networks
Weight and activation binarization is an effective approach to deep neural network
compression and can accelerate the inference by leveraging bitwise operations. Although …
compression and can accelerate the inference by leveraging bitwise operations. Although …