Deep learning a boon for biophotonics?

P Pradhan, S Guo, O Ryabchykov, J Popp… - Journal of …, 2020 - Wiley Online Library
This review covers original articles using deep learning in the biophotonic field published in
the last years. In these years deep learning, which is a subset of machine learning mostly …

Transfer learning for medical images analyses: A survey

X Yu, J Wang, QQ Hong, R Teku, SH Wang, YD Zhang - Neurocomputing, 2022 - Elsevier
The advent of deep learning has brought great change to the community of computer
science and also revitalized numerous fields where traditional machine learning methods …

Virtual adversarial training: a regularization method for supervised and semi-supervised learning

T Miyato, S Maeda, M Koyama… - IEEE transactions on …, 2018 - ieeexplore.ieee.org
We propose a new regularization method based on virtual adversarial loss: a new measure
of local smoothness of the conditional label distribution given input. Virtual adversarial loss …

Simple and scalable predictive uncertainty estimation using deep ensembles

B Lakshminarayanan, A Pritzel… - Advances in neural …, 2017 - proceedings.neurips.cc
Deep neural networks (NNs) are powerful black box predictors that have recently achieved
impressive performance on a wide spectrum of tasks. Quantifying predictive uncertainty in …

[PDF][PDF] Uncertainty in deep learning

Y Gal - 2016 - 106.54.215.74
PowerPoint 演示文稿 Page 1 Uncertainty in Deep Learning Yarin Gal 2018.7.29 Page 2 Page
3 Different Uncertainties Two main types of uncertainty, often confused by practitioners, but …

Variational dropout sparsifies deep neural networks

D Molchanov, A Ashukha… - … conference on machine …, 2017 - proceedings.mlr.press
We explore a recently proposed Variational Dropout technique that provided an elegant
Bayesian interpretation to Gaussian Dropout. We extend Variational Dropout to the case …

Dropout as a bayesian approximation: Representing model uncertainty in deep learning

Y Gal, Z Ghahramani - international conference on machine …, 2016 - proceedings.mlr.press
Deep learning tools have gained tremendous attention in applied machine learning.
However such tools for regression and classification do not capture model uncertainty. In …

Variational dropout and the local reparameterization trick

DP Kingma, T Salimans… - Advances in neural …, 2015 - proceedings.neurips.cc
We explore an as yet unexploited opportunity for drastically improving the efficiency of
stochastic gradient variational Bayes (SGVB) with global model parameters. Regular SGVB …

A survey of regularization strategies for deep models

R Moradi, R Berangi, B Minaei - Artificial Intelligence Review, 2020 - Springer
The most critical concern in machine learning is how to make an algorithm that performs well
both on training data and new data. No free lunch theorem implies that each specific task …

The implicit and explicit regularization effects of dropout

C Wei, S Kakade, T Ma - International conference on …, 2020 - proceedings.mlr.press
Dropout is a widely-used regularization technique, often required to obtain state-of-the-art
for a number of architectures. This work demonstrates that dropout introduces two distinct …