Connectivity, dynamics, and memory in reservoir computing with binary and analog neurons

L Büsing, B Schrauwen, R Legenstein - Neural computation, 2010 - direct.mit.edu
Reservoir computing (RC) systems are powerful models for online computations on input
sequences. They consist of a memoryless readout neuron that is trained on top of a …

On computational power and the order-chaos phase transition in reservoir computing

B Schrauwen, L Büsing… - Advances in neural …, 2008 - proceedings.neurips.cc
Randomly connected recurrent neural circuits have proven to be very powerful models for
online computations when a trained memoryless re adout function is appended. Such …

Memory in linear recurrent neural networks in continuous time

M Hermans, B Schrauwen - Neural Networks, 2010 - Elsevier
Reservoir Computing is a novel technique which employs recurrent neural networks while
circumventing difficult training algorithms. A very recent trend in Reservoir Computing is the …

Reservoir computing with an ensemble of time-delay reservoirs

S Ortín, L Pesquera - Cognitive Computation, 2017 - Springer
Reservoir computing (RC) has attracted a lot of attention in the field of machine learning
because of its promising performance in a broad range of applications. However, it is difficult …

Reservoir computing trends

M Lukoševičius, H Jaeger, B Schrauwen - KI-Künstliche Intelligenz, 2012 - Springer
Reservoir Computing (RC) is a paradigm of understanding and training Recurrent Neural
Networks (RNNs) based on treating the recurrent part (the reservoir) differently than the …

[PDF][PDF] An overview of reservoir computing: theory, applications and implementations

B Schrauwen, D Verstraeten… - Proceedings of the 15th …, 2007 - biblio.ugent.be
Training recurrent neural networks is hard. Recently it has however been discovered that it
is possible to just construct a random recurrent topology, and only train a single linear …

Pruning and regularization in reservoir computing

X Dutoit, B Schrauwen, J Van Campenhout… - Neurocomputing, 2009 - Elsevier
Reservoir computing is a new paradigm for using recurrent neural network with a much
simpler training method. The key idea is to use a large but fixed recurrent part as a reservoir …

A theory of sequence indexing and working memory in recurrent neural networks

EP Frady, D Kleyko, FT Sommer - Neural Computation, 2018 - direct.mit.edu
To accommodate structured approaches of neural computation, we propose a class of
recurrent neural networks for indexing and storing sequences of symbols or analog data …

An experimental unification of reservoir computing methods

D Verstraeten, B Schrauwen, M d'Haene, D Stroobandt - Neural networks, 2007 - Elsevier
Three different uses of a recurrent neural network (RNN) as a reservoir that is not trained but
instead read out by a simple external classification layer have been described in the …

On the quantification of dynamics in reservoir computing

D Verstraeten, B Schrauwen - International Conference on Artificial Neural …, 2009 - Springer
Reservoir Computing (RC) offers a computationally efficient and well performing technique
for using the temporal processing power of Recurrent Neural Networks (RNNs), while …