A review on neural networks with random weights

W Cao, X Wang, Z Ming, J Gao - Neurocomputing, 2018 - Elsevier
In big data fields, with increasing computing capability, artificial neural networks have shown
great strength in solving data classification and regression problems. The traditional training …

Ensemble classification and regression-recent developments, applications and future directions

Y Ren, L Zhang, PN Suganthan - IEEE Computational …, 2016 - ieeexplore.ieee.org
Ensemble methods use multiple models to get better performance. Ensemble methods have
been used in multiple research fields such as computational intelligence, statistics and …

Towards understanding ensemble, knowledge distillation and self-distillation in deep learning

Z Allen-Zhu, Y Li - arXiv preprint arXiv:2012.09816, 2020 - arxiv.org
We formally study how ensemble of deep learning models can improve test accuracy, and
how the superior performance of ensemble can be distilled into a single model using …

Fuzziness based semi-supervised learning approach for intrusion detection system

RAR Ashfaq, XZ Wang, JZ Huang, H Abbas, YL He - Information sciences, 2017 - Elsevier
Countering cyber threats, especially attack detection, is a challenging area of research in the
field of information assurance. Intruders use polymorphic mechanisms to masquerade the …

Modeling ultrasonic welding of polymers using an optimized artificial intelligence model using a gradient-based optimizer

AH Elsheikh, M Abd Elaziz, A Vendan - Welding in the World, 2022 - Springer
In this study, a new hybrid artificial intelligence approach is proposed to model the ultrasonic
welding of a polymeric material blend. The proposed approach is composed of an ensemble …

Randomness in neural networks: an overview

S Scardapane, D Wang - Wiley Interdisciplinary Reviews: Data …, 2017 - Wiley Online Library
Neural networks, as powerful tools for data mining and knowledge engineering, can learn
from data to build feature‐based classifiers and nonlinear predictive models. Training neural …

A comprehensive evaluation of random vector functional link networks

L Zhang, PN Suganthan - Information sciences, 2016 - Elsevier
With randomly generated weights between input and hidden layers, a random vector
functional link network is a universal approximator for continuous functions on compact sets …

A survey of randomized algorithms for training neural networks

L Zhang, PN Suganthan - Information Sciences, 2016 - Elsevier
As a powerful tool for data regression and classification, neural networks have received
considerable attention from researchers in fields such as machine learning, statistics …

Why m heads are better than one: Training a diverse ensemble of deep networks

S Lee, S Purushwalkam, M Cogswell… - arXiv preprint arXiv …, 2015 - arxiv.org
Convolutional Neural Networks have achieved state-of-the-art performance on a wide range
of tasks. Most benchmarks are led by ensembles of these powerful learners, but ensembling …

Diversity in machine learning

Z Gong, P Zhong, W Hu - Ieee Access, 2019 - ieeexplore.ieee.org
Machine learning methods have achieved good performance and been widely applied in
various real-world applications. They can learn the model adaptively and be better fit for …