Diffusion policy: Visuomotor policy learning via action diffusion

C Chi, Z Xu, S Feng, E Cousineau… - … Journal of Robotics …, 2023 - journals.sagepub.com
This paper introduces Diffusion Policy, a new way of generating robot behavior by
representing a robot's visuomotor policy as a conditional denoising diffusion process. We …

Learning universal policies via text-guided video generation

Y Du, S Yang, B Dai, H Dai… - Advances in …, 2024 - proceedings.neurips.cc
A goal of artificial intelligence is to construct an agent that can solve a wide variety of tasks.
Recent progress in text-guided image synthesis has yielded models with an impressive …

SE (3) diffusion model with application to protein backbone generation

J Yim, BL Trippe, V De Bortoli, E Mathieu… - arXiv preprint arXiv …, 2023 - arxiv.org
The design of novel protein structures remains a challenge in protein engineering for
applications across biomedicine and chemistry. In this line of work, a diffusion model over …

Nifty: Neural object interaction fields for guided human motion synthesis

N Kulkarni, D Rempe, K Genova… - Proceedings of the …, 2024 - openaccess.thecvf.com
We address the problem of generating realistic 3D motions of humans interacting with
objects in a scene. Our key idea is to create a neural interaction field attached to a specific …

Goal-conditioned imitation learning using score-based diffusion policies

M Reuss, M Li, X Jia, R Lioutikov - arXiv preprint arXiv:2304.02532, 2023 - arxiv.org
We propose a new policy representation based on score-based diffusion models (SDMs).
We apply our new policy representation in the domain of Goal-Conditioned Imitation …

Compositional foundation models for hierarchical planning

A Ajay, S Han, Y Du, S Li, A Gupta… - Advances in …, 2024 - proceedings.neurips.cc
To make effective decisions in novel environments with long-horizon goals, it is crucial to
engage in hierarchical reasoning across spatial and temporal scales. This entails planning …

Distilled feature fields enable few-shot language-guided manipulation

W Shen, G Yang, A Yu, J Wong, LP Kaelbling… - arXiv preprint arXiv …, 2023 - arxiv.org
Self-supervised and language-supervised image models contain rich knowledge of the
world that is important for generalization. Many robotic tasks, however, require a detailed …

Mirror diffusion models for constrained and watermarked generation

GH Liu, T Chen, E Theodorou… - Advances in Neural …, 2024 - proceedings.neurips.cc
Modern successes of diffusion models in learning complex, high-dimensional data
distributions are attributed, in part, to their capability to construct diffusion processes with …

Enhancing Deep Reinforcement Learning: A Tutorial on Generative Diffusion Models in Network Optimization

H Du, R Zhang, Y Liu, J Wang, Y Lin… - … Surveys & Tutorials, 2024 - ieeexplore.ieee.org
Generative Diffusion Models (GDMs) have emerged as a transformative force in the realm of
Generative Artificial Intelligence (GenAI), demonstrating their versatility and efficacy across …

Chaineddiffuser: Unifying trajectory diffusion and keypose prediction for robotic manipulation

Z Xian, N Gkanatsios, T Gervet, TW Ke… - … Annual Conference on …, 2023 - openreview.net
We present ChainedDiffuser, a policy architecture that unifies action keypose prediction and
trajectory diffusion generation for learning robot manipulation from demonstrations. Our …