Tractable control for autoregressive language generation
Despite the success of autoregressive large language models in text generation, it remains
a major challenge to generate text that satisfies complex constraints: sampling from the …
a major challenge to generate text that satisfies complex constraints: sampling from the …
Understanding the distillation process from deep generative models to tractable probabilistic circuits
Abstract Probabilistic Circuits (PCs) are a general and unified computational framework for
tractable probabilistic models that support efficient computation of various inference tasks …
tractable probabilistic models that support efficient computation of various inference tasks …
Sum-product networks: A survey
R Sánchez-Cauce, I París… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
A sum-product network (SPN) is a probabilistic model, based on a rooted acyclic directed
graph, in which terminal nodes represent probability distributions and non-terminal nodes …
graph, in which terminal nodes represent probability distributions and non-terminal nodes …
Sparse probabilistic circuits via pruning and growing
Probabilistic circuits (PCs) are a tractable representation of probability distributions allowing
for exact and efficient computation of likelihoods and marginals. There has been significant …
for exact and efficient computation of likelihoods and marginals. There has been significant …
SPPL: probabilistic programming with fast exact symbolic inference
We present the Sum-Product Probabilistic Language (SPPL), a new probabilistic
programming language that automatically delivers exact solutions to a broad range of …
programming language that automatically delivers exact solutions to a broad range of …
Scaling up probabilistic circuits by latent variable distillation
Probabilistic Circuits (PCs) are a unified framework for tractable probabilistic models that
support efficient computation of various probabilistic queries (eg, marginal probabilities) …
support efficient computation of various probabilistic queries (eg, marginal probabilities) …
Tractable regularization of probabilistic circuits
A Liu, G Van den Broeck - Advances in Neural Information …, 2021 - proceedings.neurips.cc
Abstract Probabilistic Circuits (PCs) are a promising avenue for probabilistic modeling. They
combine advantages of probabilistic graphical models (PGMs) with those of neural networks …
combine advantages of probabilistic graphical models (PGMs) with those of neural networks …
Acflow: Flow models for arbitrary conditional likelihoods
Understanding the dependencies among features of a dataset is at the core of most
unsupervised learning tasks. However, a majority of generative modeling approaches are …
unsupervised learning tasks. However, a majority of generative modeling approaches are …
Training and inference on any-order autoregressive models the right way
Conditional inference on arbitrary subsets of variables is a core problem in probabilistic
inference with important applications such as masked language modeling and image …
inference with important applications such as masked language modeling and image …
Probabilistic circuits that know what they don't know
Probabilistic circuits (PCs) are models that allow exact and tractable probabilistic inference.
In contrast to neural networks, they are often assumed to be well-calibrated and robust to out …
In contrast to neural networks, they are often assumed to be well-calibrated and robust to out …