RoboCraft: Learning to see, simulate, and shape elasto-plastic objects in 3D with graph networks

H Shi, H Xu, Z Huang, Y Li… - The International Journal …, 2024 - journals.sagepub.com
Modeling and manipulating elasto-plastic objects are essential capabilities for robots to
perform complex industrial and household interaction tasks (eg, stuffing dumplings, rolling …

Deformable object manipulation in caregiving scenarios: A review

L Wang, J Zhu - Machines, 2023 - mdpi.com
This paper reviews the robotic manipulation of deformable objects in caregiving scenarios.
Deformable objects like clothing, food, and medical supplies are ubiquitous in care tasks, yet …

Phone2proc: Bringing robust robots into our chaotic world

M Deitke, R Hendrix, A Farhadi… - Proceedings of the …, 2023 - openaccess.thecvf.com
Training embodied agents in simulation has become mainstream for the embodied AI
community. However, these agents often struggle when deployed in the physical world due …

Computational Sensing, Understanding, and Reasoning: An Artificial Intelligence Approach to Physics-Informed World Modeling

B Moya, A Badías, D González, F Chinesta… - … Methods in Engineering, 2024 - Springer
This work offers a discussion on how computational mechanics and physics-informed
machine learning can be integrated into the process of sensing, understanding, and …

Virdo++: Real-world, visuo-tactile dynamics and perception of deformable objects

Y Wi, A Zeng, P Florence, N Fazeli - arXiv preprint arXiv:2210.03701, 2022 - arxiv.org
Deformable objects manipulation can benefit from representations that seamlessly integrate
vision and touch while handling occlusions. In this work, we present a novel approach for …

Adaptsim: Task-driven simulation adaptation for sim-to-real transfer

AZ Ren, H Dai, B Burchfiel, A Majumdar - arXiv preprint arXiv:2302.04903, 2023 - arxiv.org
Simulation parameter settings such as contact models and object geometry approximations
are critical to training robust robotic policies capable of transferring from simulation to real …

DeformNet: Latent Space Modeling and Dynamics Prediction for Deformable Object Manipulation

C Li, Z Ai, T Wu, X Li, W Ding, H Xu - arXiv preprint arXiv:2402.07648, 2024 - arxiv.org
Manipulating deformable objects is a ubiquitous task in household environments,
demanding adequate representation and accurate dynamics prediction due to the objects' …

Real-to-sim deformable object manipulation: Optimizing physics models with residual mappings for robotic surgery

X Liang, F Liu, Y Zhang, Y Li, S Lin… - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
Accurate deformable object manipulation (DOM) is essential for achieving autonomy in
robotic surgery, where soft tissues are being displaced, stretched, and dissected. Many DOM …

Registration of deformed tissue: A gnn-vae approach with data assimilation for sim-to-real transfer

M Afshar, T Meyer, RS Sloboda… - IEEE/ASME …, 2023 - ieeexplore.ieee.org
In image-guided surgery, deformation of soft tissues can cause substantial errors in targeting
internal targets, since deformation can affect the translation of preoperative image-based …

Learning to Simulate Tree-Branch Dynamics for Manipulation

J Jacob, T Bandyopadhyay, J Williams… - IEEE Robotics and …, 2024 - ieeexplore.ieee.org
We propose to use a simulation driven inverse inference approach to model the dynamics of
tree branches under manipulation. Learning branch dynamics and gaining the ability to …