Hoi-diff: Text-driven synthesis of 3d human-object interactions using diffusion models

X Peng, Y Xie, Z Wu, V Jampani, D Sun… - arXiv preprint arXiv …, 2023 - arxiv.org
We address the problem of generating realistic 3D human-object interactions (HOIs) driven
by textual prompts. Instead of a single model, our key insight is to take a modular design and …

One-shot open affordance learning with foundation models

G Li, D Sun, L Sevilla-Lara… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Abstract We introduce One-shot Open Affordance Learning (OOAL) where a model is trained
with just one example per base object category but is expected to identify novel objects and …

Language-driven 6-dof grasp detection using negative prompt guidance

T Nguyen, MN Vu, B Huang, A Vuong, Q Vuong… - … on Computer Vision, 2025 - Springer
DoF grasp detection has been a fundamental and challenging problem in robotic vision.
While previous works have focused on ensuring grasp stability, they often do not consider …

Lan-grasp: Using large language models for semantic object grasping

R Mirjalili, M Krawez, S Silenzi, Y Blei… - arXiv preprint arXiv …, 2023 - arxiv.org
In this paper, we propose LAN-grasp, a novel approach towards more appropriate semantic
grasping. We use foundation models to provide the robot with a deeper understanding of the …

Language-conditioned affordance-pose detection in 3d point clouds

T Nguyen, MN Vu, B Huang, T Van Vo… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Affordance detection and pose estimation are of great importance in many robotic
applications. Their combination helps the robot gain an enhanced manipulation capability …

Grasp-anything: Large-scale grasp dataset from foundation models

AD Vuong, MN Vu, H Le, B Huang, B Huynh… - arXiv preprint arXiv …, 2023 - arxiv.org
Foundation models such as ChatGPT have made significant strides in robotic tasks due to
their universal representation of real-world domains. In this paper, we leverage foundation …

Learning 6-dof fine-grained grasp detection based on part affordance grounding

Y Song, P Sun, P Jin, Y Ren, Y Zheng, Z Li… - arXiv preprint arXiv …, 2023 - arxiv.org
Robotic grasping is a fundamental ability for a robot to interact with the environment. Current
methods focus on how to obtain a stable and reliable grasping pose in object level, while …

Open-vocabulary affordance detection using knowledge distillation and text-point correlation

T Van Vo, MN Vu, B Huang, T Nguyen… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Affordance detection presents intricate challenges and has a wide range of robotic
applications. Previous works have faced limitations such as the complexities of 3D object …

LLM-enhanced Scene Graph Learning for Household Rearrangement

W Li, Z Yu, Q She, Z Yu, Y Lan, C Zhu, R Hu… - SIGGRAPH Asia 2024 …, 2024 - dl.acm.org
The household rearrangement task involves spotting misplaced objects in a scene and
accommodate them with proper places. It depends both on common-sense knowledge on …

Learning precise affordances from egocentric videos for robotic manipulation

G Li, N Tsagkas, J Song, R Mon-Williams… - arXiv preprint arXiv …, 2024 - arxiv.org
Affordance, defined as the potential actions that an object offers, is crucial for robotic
manipulation tasks. A deep understanding of affordance can lead to more intelligent AI …