Designing neural networks through neuroevolution

KO Stanley, J Clune, J Lehman… - Nature Machine …, 2019 - nature.com
Much of recent machine learning has focused on deep learning, in which neural network
weights are trained through variants of stochastic gradient descent. An alternative approach …

[HTML][HTML] Evolutionary robotics: what, why, and where to

S Doncieux, N Bredeche, JB Mouret… - Frontiers in Robotics and …, 2015 - frontiersin.org
Evolutionary robotics applies the selection, variation, and heredity principles of natural
evolution to the design of robots with embodied intelligence. It can be considered as a …

Illuminating search spaces by mapping elites

JB Mouret, J Clune - arXiv preprint arXiv:1504.04909, 2015 - arxiv.org
Many fields use search algorithms, which automatically explore a search space to find high-
performing solutions: chemists search through the space of molecules to discover new …

Seeing is believing: Brain-inspired modular training for mechanistic interpretability

Z Liu, E Gan, M Tegmark - Entropy, 2023 - mdpi.com
We introduce Brain-Inspired Modular Training (BIMT), a method for making neural networks
more modular and interpretable. Inspired by brains, BIMT embeds neurons in a geometric …

AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligence

J Clune - arXiv preprint arXiv:1905.10985, 2019 - arxiv.org
Perhaps the most ambitious scientific quest in human history is the creation of general
artificial intelligence, which roughly means AI that is as smart or smarter than humans. The …

A systematic literature review of the successors of “neuroevolution of augmenting topologies”

E Papavasileiou, J Cornelis… - Evolutionary …, 2021 - ieeexplore.ieee.org
NeuroEvolution (NE) refers to a family of methods for optimizing Artificial Neural Networks
(ANNs) using Evolutionary Computation (EC) algorithms. NeuroEvolution of Augmenting …

A review of modularization techniques in artificial neural networks

M Amer, T Maul - Artificial Intelligence Review, 2019 - Springer
Artificial neural networks (ANNs) have achieved significant success in tackling classical and
modern machine learning problems. As learning problems grow in scale and complexity …

[HTML][HTML] The evolutionary origins of hierarchy

H Mengistu, J Huizinga, JB Mouret… - PLoS computational …, 2016 - journals.plos.org
Hierarchical organization—the recursive composition of sub-modules—is ubiquitous in
biological networks, including neural, metabolic, ecological, and genetic regulatory …

[HTML][HTML] Diffusion-based neuromodulation can eliminate catastrophic forgetting in simple neural networks

R Velez, J Clune - PloS one, 2017 - journals.plos.org
A long-term goal of AI is to produce agents that can learn a diversity of skills throughout their
lifetimes and continuously improve those skills via experience. A longstanding obstacle …

Modularity in deep learning: A survey

H Sun, I Guyon - Science and Information Conference, 2023 - Springer
Modularity is a general principle present in many fields. It offers attractive advantages,
including, among others, ease of conceptualization, interpretability, scalability, module …