General in-hand object rotation with vision and touch

H Qi, B Yi, S Suresh, M Lambeta, Y Ma… - … on Robot Learning, 2023 - proceedings.mlr.press
We introduce Rotateit, a system that enables fingertip-based object rotation along multiple
axes by leveraging multimodal sensory inputs. Our system is trained in simulation, where it …

Unidexgrasp: Universal robotic dexterous grasping via learning diverse proposal generation and goal-conditioned policy

Y Xu, W Wan, J Zhang, H Liu, Z Shan… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this work, we tackle the problem of learning universal robotic dexterous grasping from a
point cloud observation under a table-top setting. The goal is to grasp and lift up objects in …

Unidexgrasp++: Improving dexterous grasping policy learning via geometry-aware curriculum and iterative generalist-specialist learning

W Wan, H Geng, Y Liu, Z Shan… - Proceedings of the …, 2023 - openaccess.thecvf.com
We propose a novel, object-agnostic method for learning a universal policy for dexterous
object grasping from realistic point cloud observations and proprioceptive information under …

Rotating without seeing: Towards in-hand dexterity through touch

ZH Yin, B Huang, Y Qin, Q Chen, X Wang - arXiv preprint arXiv …, 2023 - arxiv.org
Tactile information plays a critical role in human dexterity. It reveals useful contact
information that may not be inferred directly from vision. In fact, humans can even perform in …

Anyteleop: A general vision-based dexterous robot arm-hand teleoperation system

Y Qin, W Yang, B Huang, K Van Wyk, H Su… - arXiv preprint arXiv …, 2023 - arxiv.org
Vision-based teleoperation offers the possibility to endow robots with human-level
intelligence to physically interact with the environment, while only requiring low-cost camera …

Robot synesthesia: In-hand manipulation with visuotactile sensing

Y Yuan, H Che, Y Qin, B Huang, ZH Yin… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Executing contact-rich manipulation tasks necessitates the fusion of tactile and visual
feedback. However, the distinct nature of these modalities poses significant challenges. In …

ArtiGrasp: Physically plausible synthesis of bi-manual dexterous grasping and articulation

H Zhang, S Christen, Z Fan, L Zheng… - … Conference on 3D …, 2024 - ieeexplore.ieee.org
We present ArtiGrasp, a novel method to synthesize bimanual hand-object interactions that
include grasping and articulation. This task is challenging due to the diversity of the global …

Learning score-based grasping primitive for human-assisting dexterous grasping

T Wu, M Wu, J Zhang, Y Gan… - Advances in Neural …, 2024 - proceedings.neurips.cc
The use of anthropomorphic robotic hands for assisting individuals in situations where
human hands may be unavailable or unsuitable has gained significant importance. In this …

Sequential dexterity: Chaining dexterous policies for long-horizon manipulation

Y Chen, C Wang, L Fei-Fei, CK Liu - arXiv preprint arXiv:2309.00987, 2023 - arxiv.org
Many real-world manipulation tasks consist of a series of subtasks that are significantly
different from one another. Such long-horizon, complex tasks highlight the potential of …

Stanford-ORB: a real-world 3d object inverse rendering benchmark

Z Kuang, Y Zhang, HX Yu… - Advances in Neural …, 2024 - proceedings.neurips.cc
We introduce Stanford-ORB, a new real-world 3D Object inverse Rendering Benchmark.
Recent advances in inverse rendering have enabled a wide range of real-world applications …