Tractable control for autoregressive language generation

H Zhang, M Dang, N Peng… - … on Machine Learning, 2023 - proceedings.mlr.press
Despite the success of autoregressive large language models in text generation, it remains
a major challenge to generate text that satisfies complex constraints: sampling from the …

Understanding the distillation process from deep generative models to tractable probabilistic circuits

X Liu, A Liu, G Van den Broeck… - … Conference on Machine …, 2023 - proceedings.mlr.press
Abstract Probabilistic Circuits (PCs) are a general and unified computational framework for
tractable probabilistic models that support efficient computation of various inference tasks …

Sum-product networks: A survey

R Sánchez-Cauce, I París… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
A sum-product network (SPN) is a probabilistic model, based on a rooted acyclic directed
graph, in which terminal nodes represent probability distributions and non-terminal nodes …

Sparse probabilistic circuits via pruning and growing

M Dang, A Liu… - Advances in Neural …, 2022 - proceedings.neurips.cc
Probabilistic circuits (PCs) are a tractable representation of probability distributions allowing
for exact and efficient computation of likelihoods and marginals. There has been significant …

SPPL: probabilistic programming with fast exact symbolic inference

FA Saad, MC Rinard, VK Mansinghka - Proceedings of the 42nd acm …, 2021 - dl.acm.org
We present the Sum-Product Probabilistic Language (SPPL), a new probabilistic
programming language that automatically delivers exact solutions to a broad range of …

Scaling up probabilistic circuits by latent variable distillation

A Liu, H Zhang, GV Broeck - arXiv preprint arXiv:2210.04398, 2022 - arxiv.org
Probabilistic Circuits (PCs) are a unified framework for tractable probabilistic models that
support efficient computation of various probabilistic queries (eg, marginal probabilities) …

Tractable regularization of probabilistic circuits

A Liu, G Van den Broeck - Advances in Neural Information …, 2021 - proceedings.neurips.cc
Abstract Probabilistic Circuits (PCs) are a promising avenue for probabilistic modeling. They
combine advantages of probabilistic graphical models (PGMs) with those of neural networks …

Acflow: Flow models for arbitrary conditional likelihoods

Y Li, S Akbar, J Oliva - International Conference on Machine …, 2020 - proceedings.mlr.press
Understanding the dependencies among features of a dataset is at the core of most
unsupervised learning tasks. However, a majority of generative modeling approaches are …

Training and inference on any-order autoregressive models the right way

A Shih, D Sadigh, S Ermon - Advances in Neural …, 2022 - proceedings.neurips.cc
Conditional inference on arbitrary subsets of variables is a core problem in probabilistic
inference with important applications such as masked language modeling and image …

Probabilistic circuits that know what they don't know

F Ventola, S Braun, Y Zhongjie… - Uncertainty in …, 2023 - proceedings.mlr.press
Probabilistic circuits (PCs) are models that allow exact and tractable probabilistic inference.
In contrast to neural networks, they are often assumed to be well-calibrated and robust to out …