Three Decades of Activations: A Comprehensive Survey of 400 Activation Functions for Neural Networks

V Kunc, J Kléma - arXiv preprint arXiv:2402.09092, 2024 - arxiv.org
Neural networks have proven to be a highly effective tool for solving complex problems in
many areas of life. Recently, their importance and practical usability have further been …

[HTML][HTML] Enhancing Land Cover/Land Use (LCLU) classification through a comparative analysis of hyperparameters optimization approaches for deep neural network …

A Azedou, A Amine, I Kisekka, S Lahssini… - Ecological …, 2023 - Elsevier
Sustainable natural resources management relies on effective and timely assessment of
conservation and land management practices. Using satellite imagery for Earth observation …

The impact of data processing and ensemble on breast cancer detection using deep learning

A Mohamed, E Amer, N Eldin, M Hossam… - Journal of Computing …, 2022 - journals.ekb.eg
According to the World Health Organization, cancer is the second leading cause of mortality.
Breast cancer is the most prevalent cancer diagnosed in women around the world. Breast …

Revealing gene regulation-based neural network computing in bacteria

SS Somathilaka, S Balasubramaniam, DP Martins… - Biophysical Reports, 2023 - cell.com
Bacteria are known to interpret a range of external molecular signals that are crucial for
sensing environmental conditions and adapting their behaviors accordingly. These external …

Nextdet: Efficient sparse-to-dense object detection with attentive feature aggregation

P Kalgaonkar, M El-Sharkawy - Future Internet, 2022 - mdpi.com
Object detection is a computer vision task of detecting instances of objects of a certain class,
identifying types of objects, determining its location, and accurately labelling them in an …

Machine learning approach for diagnosis of heart diseases

M Makram, N Ali, A Mohammed - 2022 2nd International Mobile …, 2022 - ieeexplore.ieee.org
For decades, cardiovascular diseases have been the leading cause of death. According to
the most recent WHO data, coronary heart disease deaths in Egypt accounted for 29.38 …

PSO-convolutional neural networks with heterogeneous learning rate

NH Phong, A Santos, B Ribeiro - IEEE Access, 2022 - ieeexplore.ieee.org
Convolutional Neural Networks (ConvNets or CNNs) have been candidly deployed in the
scope of computer vision and related fields. Nevertheless, the dynamics of training of these …

Deep learning with ExtendeD Exponential Linear Unit (DELU)

B Çatalbaş, Ö Morgül - Neural Computing and Applications, 2023 - Springer
Activation functions are crucial parts of artificial neural networks. From the first perceptron
created artificially up to today, many functions are proposed. Some of them are currently in …

PolyLU: A simple and robust polynomial-based linear unit activation function for deep learning

HS Feng, CH Yang - IEEE Access, 2023 - ieeexplore.ieee.org
The activation function has a critical influence on whether a convolutional neural network in
deep learning can converge or not; a proper activation function not only makes the …

Holy quran-italian seq2seq machine translation with attention mechanism

H Hamed, AM Helmy… - 2022 2nd International …, 2022 - ieeexplore.ieee.org
Many machine translation studies have used large parallel groups to address sets of major
European dialects. However, due to the lack of sufficient parallel information, few studies …