Adaptive inference through early-exit networks: Design, challenges and directions

S Laskaridis, A Kouris, ND Lane - … of the 5th International Workshop on …, 2021 - dl.acm.org
DNNs are becoming less and less over-parametrised due to recent advances in efficient
model design, through careful hand-crafted or NAS-based methods. Relying on the fact that …

Deep neural network–based enhancement for image and video streaming systems: A survey and future directions

R Lee, SI Venieris, ND Lane - ACM Computing Surveys (CSUR), 2021 - dl.acm.org
Internet-enabled smartphones and ultra-wide displays are transforming a variety of visual
apps spanning from on-demand movies and 360° videos to video-conferencing and live …

SPINN: synergistic progressive inference of neural networks over device and cloud

S Laskaridis, SI Venieris, M Almeida… - Proceedings of the 26th …, 2020 - dl.acm.org
Despite the soaring use of convolutional neural networks (CNNs) in mobile applications,
uniformly sustaining high-performance inference on mobile has been elusive due to the …

HAPI: Hardware-aware progressive inference

S Laskaridis, SI Venieris, H Kim, ND Lane - Proceedings of the 39th …, 2020 - dl.acm.org
Convolutional neural networks (CNNs) have recently become the state-of-the-art in a
diversity of AI tasks. Despite their popularity, CNN inference still comes at a high …

A survey of open-source tools for FPGA-based inference of artificial neural networks

M Lebedev, P Belecky - 2021 Ivannikov Memorial Workshop …, 2021 - ieeexplore.ieee.org
During the recent years artificial neural networks have become a great part of everyday life.
One of the big problems in AI is acceleration of neural network inference using different …

unzipFPGA: Enhancing FPGA-based CNN engines with on-the-fly weights generation

SI Venieris, J Fernandez-Marques… - 2021 IEEE 29th Annual …, 2021 - ieeexplore.ieee.org
Single computation engines have become a popular design choice for FPGA-based
convolutional neural networks (CNNs) enabling the deployment of diverse models without …

Class-specific early exit design methodology for convolutional neural networks

V Bonato, CS Bouganis - Applied Soft Computing, 2021 - Elsevier
Abstract Convolutional Neural Network-based (CNN) inference is a demanding
computational task where a long sequence of operations is applied to an input as dictated …

Mitigating Memory Wall Effects in CNN Engines with On-the-Fly Weights Generation

SI Venieris, J Fernandez-Marques… - ACM Transactions on …, 2023 - dl.acm.org
The unprecedented accuracy of convolutional neural networks (CNNs) across a broad
range of AI tasks has led to their widespread deployment in mobile and embedded settings …

How to reach real-time AI on consumer devices? Solutions for programmable and custom architectures

SI Venieris, I Panopoulos, I Leontiadis… - 2021 IEEE 32nd …, 2021 - ieeexplore.ieee.org
The unprecedented performance of deep neural networks (DNNs) has led to large strides in
various Artificial Intelligence (AI) inference tasks, such as object and speech recognition …

Edge-cloud collaboration for human activity recognition on multiple subjects

W Xiao, L Xie, J Ning, Z Fu, M Zhao… - 2022 IEEE 23rd …, 2022 - ieeexplore.ieee.org
Multi-subject video analysis is one of the most important problems in the field of visual
perception for human activity recognition on multiple subjects nowadays. However, multi …