Semi-amortized variational autoencoders

Y Kim, S Wiseman, A Miller… - … on Machine Learning, 2018 - proceedings.mlr.press
variational parameters. We propose a hybrid approach, to use AVI to initialize the variational
parameters and run stochastic variational … This semi-amortized approach enables the use of …

Recursive inference for variational autoencoders

M Kim, V Pavlovic - Advances in Neural Information …, 2020 - proceedings.neurips.cc
… Our method is motivated by the premise of the semi-amortized inference (SAVI), ie, refining
the variational posterior to further reduce the difference from the true posterior. However, …

Gaussian process modeling of approximate inference errors for variational autoencoders

M Kim - Proceedings of the IEEE/CVF Conference on …, 2022 - openaccess.thecvf.com
… Whereas the semi-amortized approaches perform extra SVI … faster than that of semiamortized
methods, accomplished by a … -of-the-art semi-amortized approaches and even the high-…

Reducing the amortization gap in variational autoencoders: A Bayesian random function approach

M Kim, V Pavlovic - arXiv preprint arXiv:2102.03151, 2021 - arxiv.org
… s variational posterior distributions from the true posteriors can be naturally regarded as random
noise. Whereas the semi-amortized … than that of semi-amortized methods, accomplished …

Training variational autoencoders with buffered stochastic variational inference

R Shu, H Bui, J Whang… - The 22nd International …, 2019 - proceedings.mlr.press
… The recognition network in deep latent variable models such as variational autoencoders
(VAEs) relies on amortized inference for efficient posterior approximation that can scale up to …

Variational laplace autoencoders

Y Park, C Kim, G Kim - International conference on machine …, 2019 - proceedings.mlr.press
… 2014) using the standard fully-factorized Gaussian assumption, (2) SemiAmortized VAE (SA-VAE)
which extends the VAE using gradient-based updates of variational parameters (Kim …

Consistency regularization for variational auto-encoders

S Sinha, AB Dieng - Advances in Neural Information …, 2021 - proceedings.neurips.cc
… posits a variational family … AutoEncoder to learn unsupervised representations from the
point cloud data. To add consistency regularization, we first substitute the AutoEncoder

Regularizing variational autoencoder with diversity and uncertainty awareness

D Shen, C Qin, C Wang, H Zhu, E Chen… - arXiv preprint arXiv …, 2021 - arxiv.org
… , Variational Autoencoder (VAE) approximates the posterior of latent variables based on
amortized variationalSemiamortized variational autoencoders. In ICML, 2018. [Kingma and Ba, …

Failure modes of variational autoencoders and their effects on downstream tasks

Y Yacoby, W Pan, F Doshi-Velez - arXiv preprint arXiv:2007.07124, 2020 - arxiv.org
Variational Auto-encoders (VAEs) are deep generative latent variable models that transform
simple … Variational auto-encoders are widely used by practitioners due to the ease of their …

Lagging inference networks and posterior collapse in variational autoencoders

J He, D Spokoyny, G Neubig… - arXiv preprint arXiv …, 2019 - arxiv.org
… The resulting semi-amortized approach empirically avoided collapse and obtained better
ELBO. However, because of the costly instancespecific local inference steps, the new method …