Sdedit: Guided image synthesis and editing with stochastic differential equations

C Meng, Y He, Y Song, J Song, J Wu, JY Zhu… - arXiv preprint arXiv …, 2021 - arxiv.org
Guided image synthesis enables everyday users to create and edit photo-realistic images
with minimum effort. The key challenge is balancing faithfulness to the user input (eg, hand …

How to train your energy-based models

Y Song, DP Kingma - arXiv preprint arXiv:2101.03288, 2021 - arxiv.org
Energy-Based Models (EBMs), also known as non-normalized probabilistic models, specify
probability density or mass functions up to an unknown normalizing constant. Unlike most …

Implicit generation and modeling with energy based models

Y Du, I Mordatch - Advances in Neural Information …, 2019 - proceedings.neurips.cc
Energy based models (EBMs) are appealing due to their generality and simplicity in
likelihood modeling, but have been traditionally difficult to train. We present techniques to …

Learning generative vision transformer with energy-based latent space for saliency prediction

J Zhang, J Xie, N Barnes, P Li - Advances in Neural …, 2021 - proceedings.neurips.cc
Vision transformer networks have shown superiority in many computer vision tasks. In this
paper, we take a step further by proposing a novel generative vision transformer with latent …

Learning non-convergent non-persistent short-run mcmc toward energy-based model

E Nijkamp, M Hill, SC Zhu… - Advances in Neural …, 2019 - proceedings.neurips.cc
This paper studies a curious phenomenon in learning energy-based model (EBM) using
MCMC. In each learning iteration, we generate synthesized examples by running a non …

Improved contrastive divergence training of energy based models

Y Du, S Li, J Tenenbaum, I Mordatch - arXiv preprint arXiv:2012.01316, 2020 - arxiv.org
Contrastive divergence is a popular method of training energy-based models, but is known
to have difficulties with training stability. We propose an adaptation to improve contrastive …

Learning latent space energy-based prior model

B Pang, T Han, E Nijkamp, SC Zhu… - Advances in Neural …, 2020 - proceedings.neurips.cc
We propose an energy-based model (EBM) in the latent space of a generator model, so that
the EBM serves as a prior model that stands on the top-down network of the generator …

On the anatomy of mcmc-based maximum likelihood learning of energy-based models

E Nijkamp, M Hill, T Han, SC Zhu, YN Wu - Proceedings of the AAAI …, 2020 - ojs.aaai.org
This study investigates the effects of Markov chain Monte Carlo (MCMC) sampling in
unsupervised Maximum Likelihood (ML) learning. Our attention is restricted to the family of …

[图书][B] Monte carlo methods

A Barbu, SC Zhu - 2020 - Springer
Real-world systems studied in sciences (eg, physics, chemistry, and biology) and
engineering (eg, vision, graphics, machine learning, and robotics) involve complex …

Generalized energy based models

M Arbel, L Zhou, A Gretton - arXiv preprint arXiv:2003.05033, 2020 - arxiv.org
We introduce the Generalized Energy Based Model (GEBM) for generative modelling. These
models combine two trained components: a base distribution (generally an implicit model) …