[HTML][HTML] Review of image classification algorithms based on convolutional neural networks
L Chen, S Li, Q Bai, J Yang, S Jiang, Y Miao - Remote Sensing, 2021 - mdpi.com
Image classification has always been a hot research direction in the world, and the
emergence of deep learning has promoted the development of this field. Convolutional …
emergence of deep learning has promoted the development of this field. Convolutional …
Explaining deep neural networks and beyond: A review of methods and applications
With the broader and highly successful usage of machine learning (ML) in industry and the
sciences, there has been a growing demand for explainable artificial intelligence (XAI) …
sciences, there has been a growing demand for explainable artificial intelligence (XAI) …
Deja vu: Contextual sparsity for efficient llms at inference time
Large language models (LLMs) with hundreds of billions of parameters have sparked a new
wave of exciting AI applications. However, they are computationally expensive at inference …
wave of exciting AI applications. However, they are computationally expensive at inference …
A review on weight initialization strategies for neural networks
Over the past few years, neural networks have exhibited remarkable results for various
applications in machine learning and computer vision. Weight initialization is a significant …
applications in machine learning and computer vision. Weight initialization is a significant …
On the variance of the adaptive learning rate and beyond
The learning rate warmup heuristic achieves remarkable success in stabilizing training,
accelerating convergence and improving generalization for adaptive stochastic optimization …
accelerating convergence and improving generalization for adaptive stochastic optimization …
Understanding plasticity in neural networks
Plasticity, the ability of a neural network to quickly change its predictions in response to new
information, is essential for the adaptability and robustness of deep reinforcement learning …
information, is essential for the adaptability and robustness of deep reinforcement learning …
Layer-wise relevance propagation: an overview
For a machine learning model to generalize well, one needs to ensure that its decisions are
supported by meaningful patterns in the input data. A prerequisite is however for the model …
supported by meaningful patterns in the input data. A prerequisite is however for the model …
Explainable AI methods-a brief overview
Abstract Explainable Artificial Intelligence (xAI) is an established field with a vibrant
community that has developed a variety of very successful approaches to explain and …
community that has developed a variety of very successful approaches to explain and …
Deep learning for single image super-resolution: A brief review
Single image super-resolution (SISR) is a notoriously challenging ill-posed problem that
aims to obtain a high-resolution output from one of its low-resolution versions. Recently …
aims to obtain a high-resolution output from one of its low-resolution versions. Recently …
How does batch normalization help optimization?
S Santurkar, D Tsipras, A Ilyas… - Advances in neural …, 2018 - proceedings.neurips.cc
Abstract Batch Normalization (BatchNorm) is a widely adopted technique that enables faster
and more stable training of deep neural networks (DNNs). Despite its pervasiveness, the …
and more stable training of deep neural networks (DNNs). Despite its pervasiveness, the …