A systematic literature review of the successors of “neuroevolution of augmenting topologies”

E Papavasileiou, J Cornelis… - Evolutionary …, 2021 - ieeexplore.ieee.org
NeuroEvolution (NE) refers to a family of methods for optimizing Artificial Neural Networks
(ANNs) using Evolutionary Computation (EC) algorithms. NeuroEvolution of Augmenting …

Three Decades of Activations: A Comprehensive Survey of 400 Activation Functions for Neural Networks

V Kunc, J Kléma - arXiv preprint arXiv:2402.09092, 2024 - arxiv.org
Neural networks have proven to be a highly effective tool for solving complex problems in
many areas of life. Recently, their importance and practical usability have further been …

Evolutionary optimization of deep learning activation functions

G Bingham, W Macke, R Miikkulainen - Proceedings of the 2020 Genetic …, 2020 - dl.acm.org
The choice of activation function can have a large effect on the performance of a neural
network. While there have been some attempts to hand-engineer novel activation functions …

[HTML][HTML] Towards activation function search for long short-term model network: A differential evolution based approach

K Vijayaprabakaran, K Sathiyamurthy - Journal of King Saud University …, 2022 - Elsevier
Abstract In Deep Neural Networks (DNNs), several architectures had been proposed for the
various complex tasks such as Machine Translation, Natural Language processing and time …

The quest for the golden activation function

M Basirat, PM Roth - arXiv preprint arXiv:1808.00783, 2018 - arxiv.org
Deep Neural Networks have been shown to be beneficial for a variety of tasks, in particular
allowing for end-to-end learning and reducing the requirement for manual design decisions …

Information theory-based evolution of neural networks for side-channel analysis

RY Acharya, F Ganji, D Forte - IACR Transactions on Cryptographic …, 2022 - par.nsf.gov
Profiled side-channel analysis (SCA) leverages leakage from cryptographic
implementations to extract the secret key. When combined with advanced methods in neural …

Co-evolution of neural architectures and features for stock market forecasting: A multi-objective decision perspective

F Hafiz, J Broekaert, D La Torre, A Swain - Decision Support Systems, 2023 - Elsevier
In a multi-objective setting, a portfolio manager's highly consequential decisions can benefit
from assessing alternative forecasting models of stock index movement. The present …

Class binarization to neuroevolution for multiclass classification

G Lan, Z Gao, L Tong, T Liu - Neural Computing and Applications, 2022 - Springer
Multiclass classification is a fundamental and challenging task in machine learning. The
existing techniques of multiclass classification can be categorized as (1) decomposition into …

Modular grammatical evolution for the generation of artificial neural networks

K Soltanian, A Ebnenasir, M Afsharchi - Evolutionary computation, 2022 - direct.mit.edu
This article presents a novel method, called Modular Grammatical Evolution (MGE), toward
validating the hypothesis that restricting the solution space of NeuroEvolution to modular …

Neuroevolution for parameter adaptation in differential evolution

V Stanovov, S Akhmedova, E Semenkin - Algorithms, 2022 - mdpi.com
Parameter adaptation is one of the key research fields in the area of evolutionary
computation. In this study, the application of neuroevolution of augmented topologies to …