Three Decades of Activations: A Comprehensive Survey of 400 Activation Functions for Neural Networks
V Kunc, J Kléma - arXiv preprint arXiv:2402.09092, 2024 - arxiv.org
Neural networks have proven to be a highly effective tool for solving complex problems in
many areas of life. Recently, their importance and practical usability have further been …
many areas of life. Recently, their importance and practical usability have further been …
[HTML][HTML] Enhancing Land Cover/Land Use (LCLU) classification through a comparative analysis of hyperparameters optimization approaches for deep neural network …
Sustainable natural resources management relies on effective and timely assessment of
conservation and land management practices. Using satellite imagery for Earth observation …
conservation and land management practices. Using satellite imagery for Earth observation …
The impact of data processing and ensemble on breast cancer detection using deep learning
According to the World Health Organization, cancer is the second leading cause of mortality.
Breast cancer is the most prevalent cancer diagnosed in women around the world. Breast …
Breast cancer is the most prevalent cancer diagnosed in women around the world. Breast …
Revealing gene regulation-based neural network computing in bacteria
Bacteria are known to interpret a range of external molecular signals that are crucial for
sensing environmental conditions and adapting their behaviors accordingly. These external …
sensing environmental conditions and adapting their behaviors accordingly. These external …
Nextdet: Efficient sparse-to-dense object detection with attentive feature aggregation
P Kalgaonkar, M El-Sharkawy - Future Internet, 2022 - mdpi.com
Object detection is a computer vision task of detecting instances of objects of a certain class,
identifying types of objects, determining its location, and accurately labelling them in an …
identifying types of objects, determining its location, and accurately labelling them in an …
Machine learning approach for diagnosis of heart diseases
M Makram, N Ali, A Mohammed - 2022 2nd International Mobile …, 2022 - ieeexplore.ieee.org
For decades, cardiovascular diseases have been the leading cause of death. According to
the most recent WHO data, coronary heart disease deaths in Egypt accounted for 29.38 …
the most recent WHO data, coronary heart disease deaths in Egypt accounted for 29.38 …
PSO-convolutional neural networks with heterogeneous learning rate
Convolutional Neural Networks (ConvNets or CNNs) have been candidly deployed in the
scope of computer vision and related fields. Nevertheless, the dynamics of training of these …
scope of computer vision and related fields. Nevertheless, the dynamics of training of these …
Deep learning with ExtendeD Exponential Linear Unit (DELU)
B Çatalbaş, Ö Morgül - Neural Computing and Applications, 2023 - Springer
Activation functions are crucial parts of artificial neural networks. From the first perceptron
created artificially up to today, many functions are proposed. Some of them are currently in …
created artificially up to today, many functions are proposed. Some of them are currently in …
PolyLU: A simple and robust polynomial-based linear unit activation function for deep learning
HS Feng, CH Yang - IEEE Access, 2023 - ieeexplore.ieee.org
The activation function has a critical influence on whether a convolutional neural network in
deep learning can converge or not; a proper activation function not only makes the …
deep learning can converge or not; a proper activation function not only makes the …
Holy quran-italian seq2seq machine translation with attention mechanism
H Hamed, AM Helmy… - 2022 2nd International …, 2022 - ieeexplore.ieee.org
Many machine translation studies have used large parallel groups to address sets of major
European dialects. However, due to the lack of sufficient parallel information, few studies …
European dialects. However, due to the lack of sufficient parallel information, few studies …