Deep generative modelling: A comparative review of vaes, gans, normalizing flows, energy-based and autoregressive models

S Bond-Taylor, A Leach, Y Long… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Deep generative models are a class of techniques that train deep neural networks to model
the distribution of training samples. Research has fragmented into various interconnected …

Advances in machine-learning-based sampling motivated by lattice quantum chromodynamics

K Cranmer, G Kanwar, S Racanière… - Nature Reviews …, 2023 - nature.com
Sampling from known probability distributions is a ubiquitous task in computational science,
underlying calculations in domains from linguistics to biology and physics. Generative …

Vaebm: A symbiosis between variational autoencoders and energy-based models

Z Xiao, K Kreis, J Kautz, A Vahdat - arXiv preprint arXiv:2010.00654, 2020 - arxiv.org
Energy-based models (EBMs) have recently been successful in representing complex
distributions of small images. However, sampling from them requires expensive Markov …

Generative pointnet: Deep energy-based learning on unordered point sets for 3d generation, reconstruction and classification

J Xie, Y Xu, Z Zheng, SC Zhu… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
We propose a generative model of unordered point sets, such as point clouds, in the forms
of an energy-based model, where the energy function is parameterized by an input …

A tale of two flows: Cooperative learning of langevin flow and normalizing flow toward energy-based model

J Xie, Y Zhu, J Li, P Li - arXiv preprint arXiv:2205.06924, 2022 - arxiv.org
This paper studies the cooperative learning of two generative flow models, in which the two
models are iteratively updated based on the jointly synthesized examples. The first flow …

Structured multi-task learning for molecular property prediction

S Liu, M Qu, Z Zhang, H Cai… - … conference on artificial …, 2022 - proceedings.mlr.press
Multi-task learning for molecular property prediction is becoming increasingly important in
drug discovery. However, in contrast to other domains, the performance of multi-task …

Composing normalizing flows for inverse problems

J Whang, E Lindgren, A Dimakis - … Conference on Machine …, 2021 - proceedings.mlr.press
Given an inverse problem with a normalizing flow prior, we wish to estimate the distribution
of the underlying signal conditioned on the observations. We approach this problem as a …

[HTML][HTML] Variational Bayesian inference with complex geostatistical priors using inverse autoregressive flows

S Levy, E Laloy, N Linde - Computers & Geosciences, 2023 - Elsevier
We combine inverse autoregressive flows (IAF) and variational Bayesian inference
(variational Bayes) in the context of geophysical inversion parameterized with deep …

Learning energy-based models by cooperative diffusion recovery likelihood

Y Zhu, J Xie, Y Wu, R Gao - arXiv preprint arXiv:2309.05153, 2023 - arxiv.org
Training energy-based models (EBMs) with maximum likelihood estimation on high-
dimensional data can be both challenging and time-consuming. As a result, there a …

Bi-level doubly variational learning for energy-based latent variable models

G Kan, J Lü, T Wang, B Zhang, A Zhu… - Proceedings of the …, 2022 - openaccess.thecvf.com
Energy-based latent variable models (EBLVMs) are more expressive than conventional
energy-based models. However, its potential on visual tasks are limited by its training …