Unidexgrasp++: Improving dexterous grasping policy learning via geometry-aware curriculum and iterative generalist-specialist learning

W Wan, H Geng, Y Liu, Z Shan… - Proceedings of the …, 2023 - openaccess.thecvf.com
We propose a novel, object-agnostic method for learning a universal policy for dexterous
object grasping from realistic point cloud observations and proprioceptive information under …

Manipllm: Embodied multimodal large language model for object-centric robotic manipulation

X Li, M Zhang, Y Geng, H Geng… - Proceedings of the …, 2024 - openaccess.thecvf.com
Robot manipulation relies on accurately predicting contact points and end-effector directions
to ensure successful operation. However learning-based robot manipulation trained on a …

Partmanip: Learning cross-category generalizable part manipulation policy from point cloud observations

H Geng, Z Li, Y Geng, J Chen… - Proceedings of the …, 2023 - openaccess.thecvf.com
Learning a generalizable object manipulation policy is vital for an embodied agent to work in
complex real-world scenes. Parts, as the shared components in different object categories …

DDF-HO: hand-held object reconstruction via conditional directed distance field

C Zhang, Y Di, R Zhang, G Zhai… - Advances in …, 2024 - proceedings.neurips.cc
Reconstructing hand-held objects from a single RGB image is an important and challenging
problem. Existing works utilizing Signed Distance Fields (SDF) reveal limitations in …

ArtiGrasp: Physically plausible synthesis of bi-manual dexterous grasping and articulation

H Zhang, S Christen, Z Fan, L Zheng… - … Conference on 3D …, 2024 - ieeexplore.ieee.org
We present ArtiGrasp, a novel method to synthesize bimanual hand-object interactions that
include grasping and articulation. This task is challenging due to the diversity of the global …

Learning score-based grasping primitive for human-assisting dexterous grasping

T Wu, M Wu, J Zhang, Y Gan… - Advances in Neural …, 2024 - proceedings.neurips.cc
The use of anthropomorphic robotic hands for assisting individuals in situations where
human hands may be unavailable or unsuitable has gained significant importance. In this …

Shapellm: Universal 3d object understanding for embodied interaction

Z Qi, R Dong, S Zhang, H Geng, C Han, Z Ge… - arXiv preprint arXiv …, 2024 - arxiv.org
This paper presents ShapeLLM, the first 3D Multimodal Large Language Model (LLM)
designed for embodied interaction, exploring a universal 3D object understanding with 3D …

Moho: Learning single-view hand-held object reconstruction with multi-view occlusion-aware supervision

C Zhang, G Jiao, Y Di, G Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Previous works concerning single-view hand-held object reconstruction typically rely on
supervision from 3D ground-truth models which are hard to collect in real world. In contrast …

Grasp multiple objects with one hand

Y Li, B Liu, Y Geng, P Li, Y Yang, Y Zhu… - IEEE Robotics and …, 2024 - ieeexplore.ieee.org
The intricate kinematics of the human hand enable simultaneous grasping and manipulation
of multiple objects, essential for tasks, such as object transfer and in-hand manipulation …

Robo-abc: Affordance generalization beyond categories via semantic correspondence for robot manipulation

Y Ju, K Hu, G Zhang, G Zhang, M Jiang… - arXiv preprint arXiv …, 2024 - arxiv.org
Enabling robotic manipulation that generalizes to out-of-distribution scenes is a crucial step
toward open-world embodied intelligence. For human beings, this ability is rooted in the …