An overview of diffusion models: Applications, guided generation, statistical rates and optimization
Diffusion models, a powerful and universal generative AI technology, have achieved
tremendous success in computer vision, audio, reinforcement learning, and computational …
tremendous success in computer vision, audio, reinforcement learning, and computational …
The llama 3 herd of models
Modern artificial intelligence (AI) systems are powered by foundation models. This paper
presents a new set of foundation models, called Llama 3. It is a herd of language models …
presents a new set of foundation models, called Llama 3. It is a herd of language models …
Cross-attention makes inference cumbersome in text-to-image diffusion models
This study explores the role of cross-attention during inference in text-conditional diffusion
models. We find that cross-attention outputs converge to a fixed point after few inference …
models. We find that cross-attention outputs converge to a fixed point after few inference …
Diffusion model for data-driven black-box optimization
Generative AI has redefined artificial intelligence, enabling the creation of innovative content
and customized solutions that drive business practices into a new era of efficiency and …
and customized solutions that drive business practices into a new era of efficiency and …
Align your steps: Optimizing sampling schedules in diffusion models
Diffusion models (DMs) have established themselves as the state-of-the-art generative
modeling approach in the visual domain and beyond. A crucial drawback of DMs is their …
modeling approach in the visual domain and beyond. A crucial drawback of DMs is their …
Learning Diffusion at Lightspeed
Diffusion regulates a phenomenal number of natural processes and the dynamics of many
successful generative models. Existing models to learn the diffusion terms from …
successful generative models. Existing models to learn the diffusion terms from …
Long-form music generation with latent diffusion
Audio-based generative models for music have seen great strides recently, but so far have
not managed to produce full-length music tracks with coherent musical structure. We show …
not managed to produce full-length music tracks with coherent musical structure. We show …
Generative Image as Action Models
M Shridhar, YL Lo, S James - arXiv preprint arXiv:2407.07875, 2024 - arxiv.org
Image-generation diffusion models have been fine-tuned to unlock new capabilities such as
image-editing and novel view synthesis. Can we similarly unlock image-generation models …
image-editing and novel view synthesis. Can we similarly unlock image-generation models …
Magic Clothing: Controllable Garment-Driven Image Synthesis
We propose Magic Clothing, a latent diffusion model (LDM)-based network architecture for
an unexplored garment-driven image synthesis task. Aiming at generating customized …
an unexplored garment-driven image synthesis task. Aiming at generating customized …
Dimba: Transformer-Mamba Diffusion Models
This paper unveils Dimba, a new text-to-image diffusion model that employs a distinctive
hybrid architecture combining Transformer and Mamba elements. Specifically, Dimba …
hybrid architecture combining Transformer and Mamba elements. Specifically, Dimba …