Similarity of neural network models: A survey of functional and representational measures
Measuring similarity of neural networks to understand and improve their behavior has
become an issue of great importance and research interest. In this survey, we provide a …
become an issue of great importance and research interest. In this survey, we provide a …
Sr-init: An interpretable layer pruning method
Despite the popularization of deep neural networks (DNNs) in many fields, it is still
challenging to deploy state-of-the-art models to resource-constrained devices due to high …
challenging to deploy state-of-the-art models to resource-constrained devices due to high …
Universal structural patterns in sparse recurrent neural networks
XJ Zhang, JM Moore, G Yan, X Li - Communications Physics, 2023 - nature.com
Sparse neural networks can achieve performance comparable to fully connected networks
but need less energy and memory, showing great promise for deploying artificial intelligence …
but need less energy and memory, showing great promise for deploying artificial intelligence …
Graph-Based Similarity of Deep Neural Networks
Understanding the enigmatic black-box representations within Deep Neural Networks
(DNNs) is an essential problem in the community of deep learning. An initial step towards …
(DNNs) is an essential problem in the community of deep learning. An initial step towards …
Automatic Meter Pointer Reading Based on Knowledge Distillation
R Sun, W Yang, F Zhang, Y Xiang, H Wang… - … on Knowledge Science …, 2024 - Springer
With the rapid development of industrial automation, automatic reading of pointer meters has
become a trend of data monitoring and efficient measurement in the industrial field. In the …
become a trend of data monitoring and efficient measurement in the industrial field. In the …
SGLP: A Similarity Guided Fast Layer Partition Pruning for Compressing Large Deep Models
The deployment of Deep Neural Network (DNN)-based networks on resource-constrained
devices remains a significant challenge due to their high computational and parameter …
devices remains a significant challenge due to their high computational and parameter …
PDD: Pruning Neural Networks During Knowledge Distillation
X Dan, W Yang, F Zhang, Y Zhou, Z Yu, Z Qiu… - Cognitive …, 2024 - Springer
Although deep neural networks have developed at a high level, the large computational
requirement limits the deployment in end devices. To this end, a variety of model …
requirement limits the deployment in end devices. To this end, a variety of model …
A Generic Layer Pruning Method for Signal Modulation Recognition Deep Learning Models
With the successful application of deep learning in communications systems, deep neural
networks are becoming the preferred method for signal classification. Although these …
networks are becoming the preferred method for signal classification. Although these …
Structure of Artificial Neural Networks--Empirical Investigations
J Stier - arXiv preprint arXiv:2410.09579, 2024 - arxiv.org
Within one decade, Deep Learning overtook the dominating solution methods of countless
problems of artificial intelligence.``Deep''refers to the deep architectures with operations in …
problems of artificial intelligence.``Deep''refers to the deep architectures with operations in …
RK-CORE: An Established Methodology for Exploring the Hierarchical Structure within Datasets
Recently, the field of machine learning has undergone a transition from model-centric to
data-centric. The advancements in diverse learning tasks have been propelled by the …
data-centric. The advancements in diverse learning tasks have been propelled by the …