Robo-abc: Affordance generalization beyond categories via semantic correspondence for robot manipulation

Y Ju, K Hu, G Zhang, G Zhang, M Jiang… - European Conference on …, 2025 - Springer
Enabling robotic manipulation that generalizes to out-of-distribution scenes is a crucial step
toward the open-world embodied intelligence. For human beings, this ability is rooted in the …

LEMON: Learning 3D Human-Object Interaction Relation from 2D Images

Y Yang, W Zhai, H Luo, Y Cao… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Learning 3D human-object interaction relation is pivotal to embodied AI and interaction
modeling. Most existing methods approach the goal by learning to predict isolated …

Language-conditioned affordance-pose detection in 3d point clouds

T Nguyen, MN Vu, B Huang, T Van Vo… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Affordance detection and pose estimation are of great importance in many robotic
applications. Their combination helps the robot gain an enhanced manipulation capability …

Deep generative models in robotics: A survey on learning from multimodal demonstrations

J Urain, A Mandlekar, Y Du, M Shafiullah, D Xu… - arXiv preprint arXiv …, 2024 - arxiv.org
Learning from Demonstrations, the field that proposes to learn robot behavior models from
data, is gaining popularity with the emergence of deep generative models. Although the …

Seeing the Unseen: Visual Common Sense for Semantic Placement

R Ramrakhya, A Kembhavi, D Batra… - Proceedings of the …, 2024 - openaccess.thecvf.com
Computer vision tasks typically involve describing what is visible in an image (eg
classification detection segmentation and captioning). We study a visual common sense task …

Preafford: Universal affordance-based pre-grasping for diverse objects and environments

K Ding, B Chen, R Wu, Y Li, Z Zhang… - 2024 IEEE/RSJ …, 2024 - ieeexplore.ieee.org
Robotic manipulation with two-finger grippers is challenged by objects lacking distinct
graspable features. Traditional pre-grasping methods, which typically involve repositioning …

Eqvafford: Se (3) equivariance for point-level affordance learning

Y Chen, C Tie, R Wu, H Dong - arXiv preprint arXiv:2408.01953, 2024 - arxiv.org
Humans perceive and interact with the world with the awareness of equivariance, facilitating
us in manipulating different objects in diverse poses. For robotic manipulation, such …

A Survey of Embodied Learning for Object-Centric Robotic Manipulation

Y Zheng, L Yao, Y Su, Y Zhang, Y Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
Embodied learning for object-centric robotic manipulation is a rapidly developing and
challenging area in embodied AI. It is crucial for advancing next-generation intelligent robots …

Open-World Reinforcement Learning over Long Short-Term Imagination

J Li, Q Wang, Y Wang, X Jin, Y Li, W Zeng… - arXiv preprint arXiv …, 2024 - arxiv.org
Training visual reinforcement learning agents in a high-dimensional open world presents
significant challenges. While various model-based methods have improved sample …

GAPartManip: A Large-scale Part-centric Dataset for Material-Agnostic Articulated Object Manipulation

W Cui, C Zhao, S Wei, J Zhang, H Geng… - arXiv preprint arXiv …, 2024 - arxiv.org
Effectively manipulating articulated objects in household scenarios is a crucial step toward
achieving general embodied artificial intelligence. Mainstream research in 3D vision has …