Scaling for edge inference of deep neural networks

X Xu, Y Ding, SX Hu, M Niemier, J Cong, Y Hu… - Nature Electronics, 2018 - nature.com
Deep neural networks offer considerable potential across a range of applications, from
advanced manufacturing to autonomous cars. A clear trend in deep neural networks is the …

Embedded deep neural network processing: Algorithmic and processor techniques bring deep learning to iot and edge devices

M Verhelst, B Moons - IEEE Solid-State Circuits Magazine, 2017 - ieeexplore.ieee.org
Deep learning has recently become immensely popular for image recognition, as well as for
other recognition and pattern matching tasks in, eg, speech processing, natural language …

Energy-efficient deep learning inference on edge devices

F Daghero, DJ Pagliari, M Poncino - Advances in Computers, 2021 - Elsevier
The success of deep learning comes at the cost of very high computational complexity.
Consequently, Internet of Things (IoT) edge nodes typically offload deep learning tasks to …

Efficient methods and hardware for deep learning

S Han - 2017 - search.proquest.com
The future will be populated with intelligent devices that require inexpensive, low-power
hardware platforms. Deep neural networks have evolved to be the state-of-the-art technique …

TinyML for ubiquitous edge AI

S Soro - arXiv preprint arXiv:2102.01255, 2021 - arxiv.org
TinyML is a fast-growing multidisciplinary field at the intersection of machine learning,
hardware, and software, that focuses on enabling deep learning algorithms on embedded …

Bringing AI to edge: From deep learning's perspective

D Liu, H Kong, X Luo, W Liu, R Subramaniam - Neurocomputing, 2022 - Elsevier
Edge computing and artificial intelligence (AI), especially deep learning algorithms, are
gradually intersecting to build the novel system, namely edge intelligence. However, the …

A survey on the optimization of neural network accelerators for micro-ai on-device inference

AN Mazumder, J Meng, HA Rashid… - IEEE Journal on …, 2021 - ieeexplore.ieee.org
Deep neural networks (DNNs) are being prototyped for a variety of artificial intelligence (AI)
tasks including computer vision, data analytics, robotics, etc. The efficacy of DNNs coincides …

Moving deep learning to the edge

MP Véstias, RP Duarte, JT de Sousa, HC Neto - Algorithms, 2020 - mdpi.com
Deep learning is now present in a wide range of services and applications, replacing and
complementing other machine learning algorithms. Performing training and inference of …

Resource-efficient neural networks for embedded systems

W Roth, G Schindler, B Klein, R Peharz… - Journal of Machine …, 2024 - jmlr.org
While machine learning is traditionally a resource intensive task, embedded systems,
autonomous navigation, and the vision of the Internet of Things fuel the interest in resource …

FANN-on-MCU: An open-source toolkit for energy-efficient neural network inference at the edge of the Internet of Things

X Wang, M Magno, L Cavigelli… - IEEE Internet of Things …, 2020 - ieeexplore.ieee.org
The growing number of low-power smart devices in the Internet of Things is coupled with the
concept of “edge computing” that is moving some of the intelligence, especially machine …