Design principles for lifelong learning AI accelerators

D Kudithipudi, A Daram, AM Zyarah, FT Zohora… - Nature …, 2023 - nature.com
Lifelong learning—an agent's ability to learn throughout its lifetime—is a hallmark of
biological learning systems and a central challenge for artificial intelligence (AI). The …

PERCIVAL: Open-source posit RISC-V core with quire capability

D Mallasén, R Murillo, AA Del Barrio… - … on Emerging Topics …, 2022 - ieeexplore.ieee.org
The posit representation for real numbers is an alternative to the ubiquitous IEEE 754
floating-point standard. In this work, we present PERCIVAL, an application-level posit RISC …

Dybit: Dynamic bit-precision numbers for efficient quantized neural network inference

J Zhou, J Wu, Y Gao, Y Ding, C Tao, B Li… - … on Computer-Aided …, 2023 - ieeexplore.ieee.org
To accelerate the inference of deep neural networks (DNNs), quantization with low-bitwidth
numbers is actively researched. A prominent challenge is to quantize the DNN models into …

Number systems for deep neural network architectures: a survey

G Alsuhli, V Sakellariou, H Saleh, M Al-Qutayri… - arXiv preprint arXiv …, 2023 - arxiv.org
Deep neural networks (DNNs) have become an enabling component for a myriad of artificial
intelligence applications. DNNs have shown sometimes superior performance, even …

Scolar: A spiking digital accelerator with dual fixed point for continual learning

V Karia, FT Zohora, N Soures… - 2022 IEEE International …, 2022 - ieeexplore.ieee.org
Spiking neural network models when deployed in dynamic environments, catastrophically
forget previously learned tasks. In this paper, we propose a reconfigurable spiking digital …

MPTQ-ViT: Mixed-PrecisionPost-TrainingQuantizationforVisionTransformer

YS Tai - arXiv preprint arXiv:2401.14895, 2024 - arxiv.org
While vision transformers (ViTs) have shown great potential in computer vision tasks, their
intense computation and memory requirements pose challenges for practical applications …

Customizing the CVA6 RISC-V core to integrate posit and quire instructions

D Mallasén, R Murillo, AA Del Barrio… - … 37th Conference on …, 2022 - ieeexplore.ieee.org
The posit representation for real numbers, aka Unum-v3, is an alternative to substitute the
IEEE 754 standard and thus mitigate the inherent problems to the construction of floating …

ACTION: A utomated Hardware-Software C odesign Framework for Low-precision Numerical Format Selec TION in TinyML

HF Langroudi, V Karia, T Pandit, B Mashaido… - Conference on Next …, 2022 - Springer
In this paper, a new low-precision hardware-software codesign framework is presented, to
optimally select the numerical formats and bit-precision for TinyML models and benchmarks …

PositCL: Compact Continual Learning with Posit Aware Quantization

V Karia, A Zyarah, D Kudithipudi - … of the Great Lakes Symposium on …, 2024 - dl.acm.org
Neural network models catastrophically forget previously learned information while
acquiring new knowledge, requiring a fundamental change in learning models and …

A Review of Posit Arithmetic for Energy-Efficient Computation: Methodologies, Applications, and Challenges

H Zhang, Z Wei, B Yin, SB Ko - Design and Applications of Emerging …, 2023 - Springer
For many decades, IEEE floating-point formats are used as the golden numeric formats for
many applications including signal processing, linear algebra evaluation, and other …