Memristive stochastic computing for deep learning parameter optimization

C Lammie, JK Eshraghian, WD Lu… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
IEEE Transactions on Circuits and Systems II: Express Briefs, 2021ieeexplore.ieee.org
Stochastic Computing (SC) is a computing paradigm that allows for the low-cost and low-
power computation of various arithmetic operations using stochastic bit streams and digital
logic. In contrast to conventional representation schemes used within the binary domain, the
sequence of bit streams in the stochastic domain is inconsequential, and computation is
usually non-deterministic. In this brief, we exploit the stochasticity during switching of
probabilistic Conductive Bridging RAM (CBRAM) devices to efficiently generate stochastic …
Stochastic Computing (SC) is a computing paradigm that allows for the low-cost and low-power computation of various arithmetic operations using stochastic bit streams and digital logic. In contrast to conventional representation schemes used within the binary domain, the sequence of bit streams in the stochastic domain is inconsequential, and computation is usually non-deterministic. In this brief, we exploit the stochasticity during switching of probabilistic Conductive Bridging RAM (CBRAM) devices to efficiently generate stochastic bit streams in order to perform Deep Learning (DL) parameter optimization, reducing the size of Multiply and Accumulate (MAC) units by 5 orders of magnitude. We demonstrate that in using a 40-nm Complementary Metal Oxide Semiconductor (CMOS) process our scalable architecture occupies 1.55mm 2 and consumes approximately 167 μW when optimizing parameters of a Convolutional Neural Network (CNN) while it is being trained for a character recognition task, observing no notable reduction in accuracy post-training.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果