Monte carlo gradient estimation in machine learning

S Mohamed, M Rosca, M Figurnov, A Mnih - Journal of Machine Learning …, 2020 - jmlr.org
This paper is a broad and accessible survey of the methods we have at our disposal for
Monte Carlo gradient estimation in machine learning and across the statistical sciences: the …

Automatic differentiation in machine learning: a survey

AG Baydin, BA Pearlmutter, AA Radul… - Journal of machine …, 2018 - jmlr.org
Derivatives, mostly in the form of gradients and Hessians, are ubiquitous in machine
learning. Automatic differentiation (AD), also called algorithmic differentiation or simply" auto …

Transformers can do bayesian inference

S Müller, N Hollmann, SP Arango, J Grabocka… - arXiv preprint arXiv …, 2021 - arxiv.org
Currently, it is hard to reap the benefits of deep learning for Bayesian methods, which allow
the explicit specification of prior knowledge and accurately capture model uncertainty. We …

Learning disentangled representations with semi-supervised deep generative models

B Paige, JW Van De Meent… - Advances in neural …, 2017 - proceedings.neurips.cc
Variational autoencoders (VAEs) learn representations of data by jointly training a
probabilistic encoder and decoder network. Typically these models encode all features of …

An introduction to probabilistic programming

JW van de Meent, B Paige, H Yang, F Wood - arXiv preprint arXiv …, 2018 - arxiv.org
This book is a graduate-level introduction to probabilistic programming. It not only provides a
thorough background for anyone wishing to use a probabilistic programming system, but …

Deep probabilistic programming

D Tran, MD Hoffman, RA Saurous, E Brevdo… - arXiv preprint arXiv …, 2017 - arxiv.org
We propose Edward, a Turing-complete probabilistic programming language. Edward
defines two compositional representations---random variables and inference. By treating …

Likelihood-free mcmc with amortized approximate ratio estimators

J Hermans, V Begy, G Louppe - International conference on …, 2020 - proceedings.mlr.press
Posterior inference with an intractable likelihood is becoming an increasingly common task
in scientific domains which rely on sophisticated computer simulations. Typically, these …

Variational deep image restoration

JW Soh, NI Cho - IEEE Transactions on Image Processing, 2022 - ieeexplore.ieee.org
This paper presents a new variational inference framework for image restoration and a
convolutional neural network (CNN) structure that can solve the restoration problems …

Bayesian LSTM with stochastic variational inference for estimating model uncertainty in process‐based hydrological models

D Li, L Marshall, Z Liang, A Sharma… - Water Resources …, 2021 - Wiley Online Library
Significant attention has recently been paid to deep learning as a method for improved
catchment modeling. Compared with process‐based models, deep learning is often …

Learning 3d shape completion under weak supervision

D Stutz, A Geiger - International Journal of Computer Vision, 2020 - Springer
We address the problem of 3D shape completion from sparse and noisy point clouds, a
fundamental problem in computer vision and robotics. Recent approaches are either data …