Structured pruning for deep convolutional neural networks: A survey

Y He, L Xiao - IEEE transactions on pattern analysis and …, 2023 - ieeexplore.ieee.org
The remarkable performance of deep Convolutional neural networks (CNNs) is generally
attributed to their deeper and wider architectures, which can come with significant …

Meta-ticket: Finding optimal subnetworks for few-shot learning within randomly initialized neural networks

D Chijiwa, S Yamaguchi… - Advances in Neural …, 2022 - proceedings.neurips.cc
Few-shot learning for neural networks (NNs) is an important problem that aims to train NNs
with a few data. The main challenge is how to avoid overfitting since over-parameterized …

AutoFace: How to Obtain Mobile Neural Network-Based Facial Feature Extractor in Less Than 10 Minutes?

AV Savchenko - IEEE Access, 2024 - ieeexplore.ieee.org
Various mobile and edge devices have significantly different processing capabilities, making
it challenging to develop a single universal architecture of a neural network to extract facial …

MGAS: Multi-Granularity Architecture Search for Effective and Efficient Neural Networks

X Liu, D Saxena, J Cao, Y Zhao, P Ruan - arXiv preprint arXiv:2310.15074, 2023 - arxiv.org
Differentiable architecture search (DAS) has become the prominent approach in the field of
neural architecture search (NAS) due to its time-efficient automation of neural network …

Efficient NLP model finetuning via multistage data filtering

X Ouyang, SMA Ansari, FX Lin, Y Ji - arXiv preprint arXiv:2207.14386, 2022 - arxiv.org
As model finetuning is central to the modern NLP, we set to maximize its efficiency.
Motivated by redundancy in training examples and the sheer sizes of pretrained models, we …

Neural architecture search for adversarial robustness via learnable pruning

Y Li, P Zhao, R Ding, T Zhou, Y Fei, X Xu… - Frontiers in High …, 2024 - frontiersin.org
The convincing performances of deep neural networks (DNNs) can be degraded
tremendously under malicious samples, known as adversarial examples. Besides, with the …

Exploration and Optimization of Lottery Ticket Hypothesis for Few-shot Image Classification Task

C Ma, J Jia, J Huang, X Wang - 2024 Asia-Pacific Conference …, 2024 - ieeexplore.ieee.org
Few-Shot Learning (FSL) refers to the problem of learning the underlying pattern in the data
just from a few training samples. However, when using transfer learning to solve few-shot …

Toward Efficient and Robust Computer Vision for Large-Scale Edge Applications

T Vu - 2023 - search.proquest.com
The past decade has been witnessing remarkable advancements in computer vision and
deep learning algorithms, ushering in a transformative wave of large-scale edge …

[PDF][PDF] ICCAD: G: Machine Learning Algorithm and Hardware Co-Design Towards Green and Ubiquitous AI on Both Edge and Cloud

H You - src.acm.org
The escalating complexity of state-of-the-art machine learning (ML) models is marked by
their expanding parameters and the substantial floating-point operations (FLOPs) required …