A review of activation function for artificial neural network

AD Rasamoelina, F Adjailia… - 2020 IEEE 18th World …, 2020 - ieeexplore.ieee.org
The activation function plays an important role in the training and the performance of an
Artificial Neural Network. They provide the necessary non-linear properties to any Artificial …

Universal approximation and model compression for radial neural networks

I Ganev, T van Laarhoven, R Walters - arXiv preprint arXiv:2107.02550, 2021 - arxiv.org
We introduce a class of fully-connected neural networks whose activation functions, rather
than being pointwise, rescale feature vectors by a function depending only on their norm …

Review of Activation Functions in Neural Networks

O Kashyap, K Kumari, K Yadav, J Baweja… - …, 2019 - search.proquest.com
A neural network is a machine-learning solid technique that mimics human brain activity. It
consists of various layers, including an input, an output, and sometimes multiple hidden …

Demystifying Machine Learning Algorithms with Methods of Theoretical Physics

T Chotibut - acml-conf.github.io
Modern economies are fuelled by Machine Learning (ML) algorithms. Despite their
ubiquitous empirical successes, many useful algorithms exhibit obscure numerical …