[HTML][HTML] Review of image classification algorithms based on convolutional neural networks

L Chen, S Li, Q Bai, J Yang, S Jiang, Y Miao - Remote Sensing, 2021 - mdpi.com
Image classification has always been a hot research direction in the world, and the
emergence of deep learning has promoted the development of this field. Convolutional …

Explaining deep neural networks and beyond: A review of methods and applications

W Samek, G Montavon, S Lapuschkin… - Proceedings of the …, 2021 - ieeexplore.ieee.org
With the broader and highly successful usage of machine learning (ML) in industry and the
sciences, there has been a growing demand for explainable artificial intelligence (XAI) …

Deja vu: Contextual sparsity for efficient llms at inference time

Z Liu, J Wang, T Dao, T Zhou, B Yuan… - International …, 2023 - proceedings.mlr.press
Large language models (LLMs) with hundreds of billions of parameters have sparked a new
wave of exciting AI applications. However, they are computationally expensive at inference …

A review on weight initialization strategies for neural networks

MV Narkhede, PP Bartakke, MS Sutaone - Artificial intelligence review, 2022 - Springer
Over the past few years, neural networks have exhibited remarkable results for various
applications in machine learning and computer vision. Weight initialization is a significant …

On the variance of the adaptive learning rate and beyond

L Liu, H Jiang, P He, W Chen, X Liu, J Gao… - arXiv preprint arXiv …, 2019 - arxiv.org
The learning rate warmup heuristic achieves remarkable success in stabilizing training,
accelerating convergence and improving generalization for adaptive stochastic optimization …

Understanding plasticity in neural networks

C Lyle, Z Zheng, E Nikishin, BA Pires… - International …, 2023 - proceedings.mlr.press
Plasticity, the ability of a neural network to quickly change its predictions in response to new
information, is essential for the adaptability and robustness of deep reinforcement learning …

Layer-wise relevance propagation: an overview

G Montavon, A Binder, S Lapuschkin, W Samek… - … and visualizing deep …, 2019 - Springer
For a machine learning model to generalize well, one needs to ensure that its decisions are
supported by meaningful patterns in the input data. A prerequisite is however for the model …

Explainable AI methods-a brief overview

A Holzinger, A Saranti, C Molnar, P Biecek… - … workshop on extending …, 2022 - Springer
Abstract Explainable Artificial Intelligence (xAI) is an established field with a vibrant
community that has developed a variety of very successful approaches to explain and …

Deep learning for single image super-resolution: A brief review

W Yang, X Zhang, Y Tian, W Wang… - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
Single image super-resolution (SISR) is a notoriously challenging ill-posed problem that
aims to obtain a high-resolution output from one of its low-resolution versions. Recently …

How does batch normalization help optimization?

S Santurkar, D Tsipras, A Ilyas… - Advances in neural …, 2018 - proceedings.neurips.cc
Abstract Batch Normalization (BatchNorm) is a widely adopted technique that enables faster
and more stable training of deep neural networks (DNNs). Despite its pervasiveness, the …