Self-regulated feature learning via teacher-free feature distillation

L Li - European Conference on Computer Vision, 2022 - Springer
Abstract Knowledge distillation conditioned on intermediate feature representations always
leads to significant performance improvements. Conventional feature distillation framework …

Hardware-aware DNN compression via diverse pruning and mixed-precision quantization

K Balaskas, A Karatzas, C Sad… - … on Emerging Topics …, 2024 - ieeexplore.ieee.org
Deep Neural Networks (DNNs) have shown significant advantages in a wide variety of
domains. However, DNNs are becoming computationally intensive and energy hungry at an …

Improving regularization in deep neural networks by co-adaptation trace detection

H Moayed, EG Mansoori - Neural Processing Letters, 2023 - Springer
Co-adaptation of units is one of the most critical concerns in deep neural networks (DNNs),
which leads to overfitting. Dropout has been an exciting research subject in recent years to …

TargetDrop: a targeted regularization method for convolutional neural networks

H Zhu, X Zhao - … 2022-2022 IEEE International Conference on …, 2022 - ieeexplore.ieee.org
Dropout regularization has been widely used in deep learning but performs less effective for
convolutional neural networks since the spatially correlated features allow dropped …

Improved generalization performance of convolutional neural networks with LossDA

J Liu, Y Zhao - Applied Intelligence, 2023 - Springer
In recent years, convolutional neural networks (CNNs) have been used in many fields.
Nowadays, CNNs have a high learning capability, and this learning capability is …

Image translation between high-resolution optical and synthetic aperture radar (SAR) data

X Niu, D Yang, K Yang, H Pan, Y Dou… - International Journal of …, 2021 - Taylor & Francis
This paper presents a novel study: remote-sensing image translation between high-
resolution optical and Synthetic Aperture Radar (SAR) data through machine learning …

Histological tissue classification with a novel statistical filter‐based convolutional neural network

N Ünlükal, E Ülker, M Solmaz, K Uyar… - Anatomia, Histologia …, 2024 - Wiley Online Library
Deep networks have been of considerable interest in literature and have enabled the
solution of recent real‐world applications. Due to filters that offer feature extraction …

A Frobenius Norm Regularization Method for Convolutional Kernel Tensors in Neural Networks

PC Guo - Computational Intelligence and Neuroscience, 2022 - Wiley Online Library
The convolutional neural network is a very important model of deep learning. It can help
avoid the exploding/vanishing gradient problem and improve the generalizability of a neural …

A Novel Deep Learning Neural Network System for Imbalanced Heart Sounds Classification

W Chen, Q Sun, G Xie, C Xu - Journal of Mechanics in Medicine …, 2021 - World Scientific
This study proposed a novel TFNNS method, which aimed to solve the imbalanced
phonocardiogram (PCG) signals' classification. TFFNS consisted of three submodules …

Probing the Structure and Functional Properties of the Dropout-Induced Correlated Variability in Convolutional Neural Networks

X Pan, R Coen-Cagli, O Schwartz - Neural computation, 2024 - direct.mit.edu
Computational neuroscience studies have shown that the structure of neural variability to an
unchanged stimulus affects the amount of information encoded. Some artificial deep neural …