Dynamic neural networks: A survey

Y Han, G Huang, S Song, L Yang… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Dynamic neural network is an emerging research topic in deep learning. Compared to static
models which have fixed computational graphs and parameters at the inference stage …

X3d: Expanding architectures for efficient video recognition

C Feichtenhofer - Proceedings of the IEEE/CVF conference …, 2020 - openaccess.thecvf.com
This paper presents X3D, a family of efficient video networks that progressively expand a
tiny 2D image classification architecture along multiple network axes, in space, time, width …

A dynamic multi-scale voxel flow network for video prediction

X Hu, Z Huang, A Huang, J Xu… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
The performance of video prediction has been greatly boosted by advanced deep neural
networks. However, most of the current methods suffer from large model sizes and require …

Survey: Exploiting data redundancy for optimization of deep learning

JA Chen, W Niu, B Ren, Y Wang, X Shen - ACM Computing Surveys, 2023 - dl.acm.org
Data redundancy is ubiquitous in the inputs and intermediate results of Deep Neural
Networks (DNN). It offers many significant opportunities for improving DNN performance and …

Blockdrop: Dynamic inference paths in residual networks

Z Wu, T Nagarajan, A Kumar… - Proceedings of the …, 2018 - openaccess.thecvf.com
Very deep convolutional neural networks offer excellent recognition results, yet their
computational expense limits their impact for many real-world applications. We introduce …

Listen to look: Action recognition by previewing audio

R Gao, TH Oh, K Grauman… - Proceedings of the …, 2020 - openaccess.thecvf.com
In the face of the video data deluge, today's expensive clip-level classifiers are increasingly
impractical. We propose a framework for efficient action recognition in untrimmed video that …

Sst: Single-stream temporal action proposals

S Buch, V Escorcia, C Shen… - Proceedings of the …, 2017 - openaccess.thecvf.com
Our paper presents a new approach for temporal detection of human actions in long,
untrimmed video sequences. We introduce Single-Stream Temporal Action Proposals (SST) …

Adaframe: Adaptive frame selection for fast video recognition

Z Wu, C Xiong, CY Ma, R Socher… - Proceedings of the …, 2019 - openaccess.thecvf.com
We present AdaFrame, a framework that adaptively selects relevant frames on a per-input
basis for fast video recognition. AdaFrame contains a Long Short-Term Memory network …

Skip rnn: Learning to skip state updates in recurrent neural networks

V Campos, B Jou, X Giró-i-Nieto, J Torres… - arXiv preprint arXiv …, 2017 - arxiv.org
Recurrent Neural Networks (RNNs) continue to show outstanding performance in sequence
modeling tasks. However, training RNNs on long sequences often face challenges like slow …

Adapting Neural Networks at Runtime: Current Trends in At-Runtime Optimizations for Deep Learning

M Sponner, B Waschneck, A Kumar - ACM Computing Surveys, 2024 - dl.acm.org
Adaptive optimization methods for deep learning adjust the inference task to the current
circumstances at runtime to improve the resource footprint while maintaining the model's …