Backpropagation with biologically plausible spatiotemporal adjustment for training deep spiking neural networks

G Shen, D Zhao, Y Zeng - Patterns, 2022 - cell.com
Patterns, 2022cell.com
The spiking neural network (SNN) mimics the information-processing operation in the
human brain. Directly applying backpropagation to the training of the SNN still has a
performance gap compared with traditional deep neural networks. To address the problem,
we propose a biologically plausible spatial adjustment that rethinks the relationship between
membrane potential and spikes and realizes a reasonable adjustment of gradients to
different time steps. It precisely controls the backpropagation of the error along the spatial …
Summary
The spiking neural network (SNN) mimics the information-processing operation in the human brain. Directly applying backpropagation to the training of the SNN still has a performance gap compared with traditional deep neural networks. To address the problem, we propose a biologically plausible spatial adjustment that rethinks the relationship between membrane potential and spikes and realizes a reasonable adjustment of gradients to different time steps. It precisely controls the backpropagation of the error along the spatial dimension. Secondly, we propose a biologically plausible temporal adjustment to make the error propagate across the spikes in the temporal dimension, which overcomes the problem of the temporal dependency within a single spike period of traditional spiking neurons. We have verified our algorithm on several datasets, and the experimental results have shown that our algorithm greatly reduces network latency and energy consumption while also improving network performance.
cell.com
以上显示的是最相近的搜索结果。 查看全部搜索结果

Google学术搜索按钮

example.edu/paper.pdf
搜索
获取 PDF 文件
引用
References