A survey on generative diffusion models

H Cao, C Tan, Z Gao, Y Xu, G Chen… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Deep generative models have unlocked another profound realm of human creativity. By
capturing and generalizing patterns within data, we have entered the epoch of all …

Scalable adaptive computation for iterative generation

A Jabri, D Fleet, T Chen - arXiv preprint arXiv:2212.11972, 2022 - arxiv.org
Natural data is redundant yet predominant architectures tile computation uniformly across
their input and output space. We propose the Recurrent Interface Networks (RINs), an …

Diffurec: A diffusion model for sequential recommendation

Z Li, A Sun, C Li - ACM Transactions on Information Systems, 2023 - dl.acm.org
Mainstream solutions to sequential recommendation represent items with fixed vectors.
These vectors have limited capability in capturing items' latent aspects and users' diverse …

Text generation with diffusion language models: A pre-training approach with continuous paragraph denoise

Z Lin, Y Gong, Y Shen, T Wu, Z Fan… - International …, 2023 - proceedings.mlr.press
In this paper, we introduce a novel dIffusion language modEl pre-training framework for text
generation, which we call GENIE. GENIE is a large-scale pre-trained diffusion language …

Difformer: Empowering diffusion models on the embedding space for text generation

Z Gao, J Guo, X Tan, Y Zhu, F Zhang, J Bian… - arXiv preprint arXiv …, 2022 - arxiv.org
Diffusion models have achieved state-of-the-art synthesis quality on both visual and audio
tasks, and recent works further adapt them to textual data by diffusing on the embedding …

Dinoiser: Diffused conditional sequence learning by manipulating noises

J Ye, Z Zheng, Y Bao, L Qian, M Wang - arXiv preprint arXiv:2302.10025, 2023 - arxiv.org
While diffusion models have achieved great success in generating continuous signals such
as images and audio, it remains elusive for diffusion models in learning discrete sequence …

Play: Parametrically conditioned layout generation using latent diffusion

CY Cheng, F Huang, G Li, Y Li - arXiv preprint arXiv:2301.11529, 2023 - arxiv.org
Layout design is an important task in various design fields, including user interface,
document, and graphic design. As this task requires tedious manual effort by designers …

Generative flows on discrete state-spaces: Enabling multimodal flows with applications to protein co-design

A Campbell, J Yim, R Barzilay, T Rainforth… - arXiv preprint arXiv …, 2024 - arxiv.org
Combining discrete and continuous data is an important capability for generative models.
We present Discrete Flow Models (DFMs), a new flow-based model of discrete data that …

An overview of diffusion models for text generation

H Čeović, M Šilić, G Delač… - 2023 46th MIPRO ICT and …, 2023 - ieeexplore.ieee.org
Given the great success that diffusion models have achieved in generating various types of
continuous data, including image, video and audio, there has been a growing interest in the …

Diffusion models in text generation: a survey

Q Yi, X Chen, C Zhang, Z Zhou, L Zhu, X Kong - PeerJ Computer Science, 2024 - peerj.com
Diffusion models are a kind of math-based model that were first applied to image generation.
Recently, they have drawn wide interest in natural language generation (NLG), a sub-field of …