RoboCraft: Learning to see, simulate, and shape elasto-plastic objects in 3D with graph networks

H Shi, H Xu, Z Huang, Y Li… - The International Journal …, 2024 - journals.sagepub.com
Modeling and manipulating elasto-plastic objects are essential capabilities for robots to
perform complex industrial and household interaction tasks (eg, stuffing dumplings, rolling …

[HTML][HTML] Data-driven robotic manipulation of cloth-like deformable objects: The present, challenges and future prospects

HA Kadi, K Terzić - Sensors, 2023 - mdpi.com
Manipulating cloth-like deformable objects (CDOs) is a long-standing problem in the
robotics community. CDOs are flexible (non-rigid) objects that do not show a detectable level …

Planning with spatial-temporal abstraction from point clouds for deformable object manipulation

X Lin, C Qi, Y Zhang, Z Huang, K Fragkiadaki… - arXiv preprint arXiv …, 2022 - arxiv.org
Effective planning of long-horizon deformable object manipulation requires suitable
abstractions at both the spatial and temporal levels. Previous methods typically either focus …

Robotic cable routing with spatial representation

S Jin, W Lian, C Wang, M Tomizuka… - IEEE Robotics and …, 2022 - ieeexplore.ieee.org
Cable routing is a challenging task for robotic automation. To accomplish the task, it requires
a high-level path planner to generate a sequence of cable configurations from the initial …

DiffVL: scaling up soft body manipulation using vision-language driven differentiable physics

Z Huang, F Chen, Y Pu, C Lin… - Advances in Neural …, 2023 - proceedings.neurips.cc
Combining gradient-based trajectory optimization with differentiable physics simulation is an
efficient technique for solving soft-body manipulation problems. Using a well-crafted …

Visual haptic reasoning: Estimating contact forces by observing deformable object interactions

Y Wang, D Held, Z Erickson - IEEE Robotics and Automation …, 2022 - ieeexplore.ieee.org
Robotic manipulation of highly deformable cloth presents a promising opportunity to assist
people with several daily tasks, such as washing dishes; folding laundry; or dressing …

Edo-net: Learning elastic properties of deformable objects from graph dynamics

A Longhini, M Moletta, A Reichlin… - … on Robotics and …, 2023 - ieeexplore.ieee.org
We study the problem of learning graph dynamics of deformable objects that generalizes to
unknown physical properties. Our key insight is to leverage a latent representation of elastic …

Play it by ear: Learning skills amidst occlusion through audio-visual imitation learning

M Du, OY Lee, S Nair, C Finn - arXiv preprint arXiv:2205.14850, 2022 - arxiv.org
Humans are capable of completing a range of challenging manipulation tasks that require
reasoning jointly over modalities such as vision, touch, and sound. Moreover, many such …

Action-conditional implicit visual dynamics for deformable object manipulation

B Shen, Z Jiang, C Choy, S Savarese… - … Journal of Robotics …, 2024 - journals.sagepub.com
Manipulating volumetric deformable objects in the real world, like plush toys and pizza
dough, brings substantial challenges due to infinite shape variations, non-rigid motions, and …

Contact points discovery for soft-body manipulations with differentiable physics

S Li, Z Huang, T Du, H Su, JB Tenenbaum… - arXiv preprint arXiv …, 2022 - arxiv.org
Differentiable physics has recently been shown as a powerful tool for solving soft-body
manipulation tasks. However, the differentiable physics solver often gets stuck when the …