Eligibility traces and plasticity on behavioral time scales: experimental support of neohebbian three-factor learning rules

W Gerstner, M Lehmann, V Liakoni… - Frontiers in neural …, 2018 - frontiersin.org
Most elementary behaviors such as moving the arm to grasp an object or walking into the
next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal …

Neuromodulated spike-timing-dependent plasticity, and theory of three-factor learning rules

N Frémaux, W Gerstner - Frontiers in neural circuits, 2016 - frontiersin.org
Classical Hebbian learning puts the emphasis on joint pre-and postsynaptic activity, but
neglects the potential role of neuromodulators. Since neuromodulators convey information …

Incorporating learnable membrane time constant to enhance learning of spiking neural networks

W Fang, Z Yu, Y Chen, T Masquelier… - Proceedings of the …, 2021 - openaccess.thecvf.com
Abstract Spiking Neural Networks (SNNs) have attracted enormous research interest due to
temporal information processing capability, low power consumption, and high biological …

Control of synaptic plasticity in deep cortical networks

PR Roelfsema, A Holtmaat - Nature Reviews Neuroscience, 2018 - nature.com
Humans and many other animals have an enormous capacity to learn about sensory stimuli
and to master new skills. However, many of the mechanisms that enable us to learn remain …

Policy gradient and actor-critic learning in continuous time and space: Theory and algorithms

Y Jia, XY Zhou - Journal of Machine Learning Research, 2022 - jmlr.org
We study policy gradient (PG) for reinforcement learning in continuous time and space
under the regularized exploratory formulation developed by Wang et al.(2020). We …

A survey of robotics control based on learning-inspired spiking neural networks

Z Bing, C Meschede, F Röhrbein, K Huang… - Frontiers in …, 2018 - frontiersin.org
Biological intelligence processes information using impulses or spikes, which makes those
living creatures able to perceive and act in the real world exceptionally well and outperform …

A self-adaptive hardware with resistive switching synapses for experience-based neurocomputing

S Bianchi, I Muñoz-Martin, E Covi, A Bricalli… - Nature …, 2023 - nature.com
Neurobiological systems continually interact with the surrounding environment to refine their
behaviour toward the best possible reward. Achieving such learning by experience is one of …

First-spike-based visual categorization using reward-modulated STDP

M Mozafari, SR Kheradpisheh… - IEEE transactions on …, 2018 - ieeexplore.ieee.org
Reinforcement learning (RL) has recently regained popularity with major achievements such
as beating the European game of Go champion. Here, for the first time, we show that RL can …

Demonstrating advantages of neuromorphic computation: a pilot study

T Wunderlich, AF Kungl, E Müller, A Hartel… - Frontiers in …, 2019 - frontiersin.org
Neuromorphic devices represent an attempt to mimic aspects of the brain's architecture and
dynamics with the aim of replicating its hallmark functional capabilities in terms of …

Policy evaluation and temporal-difference learning in continuous time and space: A martingale approach

Y Jia, XY Zhou - Journal of Machine Learning Research, 2022 - jmlr.org
We propose a unified framework to study policy evaluation (PE) and the associated temporal
difference (TD) methods for reinforcement learning in continuous time and space. We show …