Ensemble deep learning: A review

MA Ganaie, M Hu, AK Malik, M Tanveer… - … Applications of Artificial …, 2022 - Elsevier
Ensemble learning combines several individual models to obtain better generalization
performance. Currently, deep learning architectures are showing better performance …

Ensemble deep learning in bioinformatics

Y Cao, TA Geddes, JYH Yang, P Yang - Nature Machine Intelligence, 2020 - nature.com
The remarkable flexibility and adaptability of ensemble methods and deep learning models
have led to the proliferation of their application in bioinformatics research. Traditionally …

Interpretable machine learning: Fundamental principles and 10 grand challenges

C Rudin, C Chen, Z Chen, H Huang… - Statistic …, 2022 - projecteuclid.org
Interpretability in machine learning (ML) is crucial for high stakes decisions and
troubleshooting. In this work, we provide fundamental principles for interpretable ML, and …

Deep learning: a statistical viewpoint

PL Bartlett, A Montanari, A Rakhlin - Acta numerica, 2021 - cambridge.org
The remarkable practical success of deep learning has revealed some major surprises from
a theoretical perspective. In particular, simple gradient methods easily find near-optimal …

Towards understanding ensemble, knowledge distillation and self-distillation in deep learning

Z Allen-Zhu, Y Li - arXiv preprint arXiv:2012.09816, 2020 - arxiv.org
We formally study how ensemble of deep learning models can improve test accuracy, and
how the superior performance of ensemble can be distilled into a single model using …

Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation

M Belkin - Acta Numerica, 2021 - cambridge.org
In the past decade the mathematical theory of machine learning has lagged far behind the
triumphs of deep neural networks on practical challenges. However, the gap between theory …

Max-margin token selection in attention mechanism

D Ataee Tarzanagh, Y Li, X Zhang… - Advances in Neural …, 2023 - proceedings.neurips.cc
Attention mechanism is a central component of the transformer architecture which led to the
phenomenal success of large language models. However, the theoretical principles …

Reconciling modern machine-learning practice and the classical bias–variance trade-off

M Belkin, D Hsu, S Ma… - Proceedings of the …, 2019 - National Acad Sciences
Breakthroughs in machine learning are rapidly changing science and society, yet our
fundamental understanding of this technology has lagged far behind. Indeed, one of the …

What is machine learning? A primer for the epidemiologist

Q Bi, KE Goodman, J Kaminsky… - American journal of …, 2019 - academic.oup.com
Abstract Machine learning is a branch of computer science that has the potential to transform
epidemiologic sciences. Amid a growing focus on “Big Data,” it offers epidemiologists new …

[PDF][PDF] AdaBoost 算法研究进展与展望

曹莹, 苗启广, 刘家辰, 高琳 - 自动化学报, 2013 - aas.net.cn
摘要AdaBoost 是最优秀的Boosting 算法之一, 有着坚实的理论基础, 在实践中得到了很好的
推广和应用. 算法能够将比随机猜测略好的弱分类器提升为分类精度高的强分类器 …