Score identity distillation: Exponentially fast distillation of pretrained diffusion models for one-step generation

M Zhou, H Zheng, Z Wang, M Yin… - Forty-first International …, 2024 - openreview.net
We introduce Score identity Distillation (SiD), an innovative data-free method that distills the
generative capabilities of pretrained diffusion models into a single-step generator. SiD not …

Hierarchical semi-implicit variational inference with application to diffusion model acceleration

L Yu, T Xie, Y Zhu, T Yang, X Zhang… - Advances in Neural …, 2024 - proceedings.neurips.cc
Semi-implicit variational inference (SIVI) has been introduced to expand the analytical
variational families by defining expressive semi-implicit distributions in a hierarchical …

Semi-implicit variational inference via score matching

L Yu, C Zhang - arXiv preprint arXiv:2308.10014, 2023 - arxiv.org
Semi-implicit variational inference (SIVI) greatly enriches the expressiveness of variational
families by considering implicit variational distributions defined in a hierarchical manner …

Kernel Semi-Implicit Variational Inference

Z Cheng, L Yu, T Xie, S Zhang, C Zhang - arXiv preprint arXiv:2405.18997, 2024 - arxiv.org
Semi-implicit variational inference (SIVI) extends traditional variational families with semi-
implicit distributions defined in a hierarchical manner. Due to the intractable densities of …

VFDS: Variational Foresight Dynamic Selection in Bayesian Neural Networks for Efficient Human Activity Recognition

R Ardywibowo, S Boluki, Z Wang… - International …, 2022 - proceedings.mlr.press
In many machine learning tasks, input features with varying degrees of predictive capability
are acquired at varying costs. In order to optimize the performance-cost trade-off, one would …

Bayesian Neural Network Inference via Implicit Models and the Posterior Predictive Distribution

JJ Dabrowski, DE Pagendam - arXiv preprint arXiv:2209.02188, 2022 - arxiv.org
We propose a novel approach to perform approximate Bayesian inference in complex
models such as Bayesian neural networks. The approach is more scalable to large data …

Advances in Bayesian machine learning: from uncertainty to decision making

C Ma - 2022 - repository.cam.ac.uk
Bayesian uncertainty quantification is the key element to many machine learning
applications. To this end, approximate inference algorithms are developed to perform …

TreeVI: Reparameterizable Tree-structured Variational Inference for Instance-level Correlation Capturing

J Xiao, Q Su - The Thirty-eighth Annual Conference on Neural … - openreview.net
Mean-field variational inference (VI) is computationally scalable, but its highly-demanding
independence requirement hinders it from being applied to wider scenarios. Although many …

Statistical and Computational Properties of Variational Inference

SC Plummer - 2021 - search.proquest.com
Over the past decade variational inference (VI) has surpassed Markov Chain Monte Carlo
(MCMC) as the main method for performing scalable parametric Bayesian inference …