Supervised learning in spiking neural networks: A review of algorithms and evaluations

X Wang, X Lin, X Dang - Neural Networks, 2020 - Elsevier
As a new brain-inspired computational model of the artificial neural network, a spiking
neural network encodes and processes neural information through precisely timed spike …

Neuronal reward and decision signals: from theories to data

W Schultz - Physiological reviews, 2015 - journals.physiology.org
Rewards are crucial objects that induce learning, approach behavior, choices, and
emotions. Whereas emotions are difficult to investigate in animals, the learning function is …

Superspike: Supervised learning in multilayer spiking neural networks

F Zenke, S Ganguli - Neural computation, 2018 - direct.mit.edu
A vast majority of computation in the brain is performed by spiking neural networks. Despite
the ubiquity of such spiking, we currently lack an understanding of how biological spiking …

Burst-dependent synaptic plasticity can coordinate learning in hierarchical circuits

A Payeur, J Guerguiev, F Zenke, BA Richards… - Nature …, 2021 - nature.com
Synaptic plasticity is believed to be a key physiological mechanism for learning. It is well
established that it depends on pre-and postsynaptic activity. However, models that rely …

[图书][B] Neuronal dynamics: From single neurons to networks and models of cognition

W Gerstner, WM Kistler, R Naud, L Paninski - 2014 - books.google.com
What happens in our brain when we make a decision? What triggers a neuron to send out a
signal? What is the neural code? This textbook for advanced undergraduate and beginning …

[HTML][HTML] Eligibility traces and plasticity on behavioral time scales: experimental support of neohebbian three-factor learning rules

W Gerstner, M Lehmann, V Liakoni… - Frontiers in neural …, 2018 - frontiersin.org
Most elementary behaviors such as moving the arm to grasp an object or walking into the
next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal …

[HTML][HTML] Neuromodulated spike-timing-dependent plasticity, and theory of three-factor learning rules

N Frémaux, W Gerstner - Frontiers in neural circuits, 2016 - frontiersin.org
Classical Hebbian learning puts the emphasis on joint pre-and postsynaptic activity, but
neglects the potential role of neuromodulators. Since neuromodulators convey information …

[HTML][HTML] Central cholinergic neurons are rapidly recruited by reinforcement feedback

B Hangya, SP Ranade, M Lorenc, A Kepecs - Cell, 2015 - cell.com
Basal forebrain cholinergic neurons constitute a major neuromodulatory system implicated
in normal cognition and neurodegenerative dementias. Cholinergic projections densely …

First-spike-based visual categorization using reward-modulated STDP

M Mozafari, SR Kheradpisheh… - IEEE transactions on …, 2018 - ieeexplore.ieee.org
Reinforcement learning (RL) has recently regained popularity with major achievements such
as beating the European game of Go champion. Here, for the first time, we show that RL can …

[HTML][HTML] Distinct eligibility traces for LTP and LTD in cortical synapses

K He, M Huertas, SZ Hong, XX Tie, JW Hell, H Shouval… - Neuron, 2015 - cell.com
In reward-based learning, synaptic modifications depend on a brief stimulus and a
temporally delayed reward, which poses the question of how synaptic activity patterns …