Sapien: A simulated part-based interactive environment

F Xiang, Y Qin, K Mo, Y Xia, H Zhu… - Proceedings of the …, 2020 - openaccess.thecvf.com
Building home assistant robots has long been a goal for vision and robotics researchers. To
achieve this task, a simulated environment with physically realistic simulation, sufficient …

VR content creation and exploration with deep learning: A survey

M Wang, XQ Lyu, YJ Li, FL Zhang - Computational Visual Media, 2020 - Springer
Virtual reality (VR) offers an artificial, computer generated simulation of a real life
environment. It originated in the 1960s and has evolved to provide increasing immersion …

Where2act: From pixels to actions for articulated 3d objects

K Mo, LJ Guibas, M Mukadam… - Proceedings of the …, 2021 - openaccess.thecvf.com
One of the fundamental goals of visual perception is to allow agents to meaningfully interact
with their environment. In this paper, we take a step towards that long-term goal--we extract …

Learning environment-aware affordance for 3d articulated object manipulation under occlusions

R Wu, K Cheng, Y Zhao, C Ning… - Advances in Neural …, 2024 - proceedings.neurips.cc
Perceiving and manipulating 3D articulated objects in diverse environments is essential for
home-assistant robots. Recent studies have shown that point-level affordance provides …

Scenefun3d: Fine-grained functionality and affordance understanding in 3d scenes

A Delitzas, A Takmaz, F Tombari… - Proceedings of the …, 2024 - openaccess.thecvf.com
Existing 3D scene understanding methods are heavily focused on 3D semantic and instance
segmentation. However identifying objects and their parts only constitutes an intermediate …

Flowbot3d: Learning 3d articulation flow to manipulate articulated objects

B Eisner, H Zhang, D Held - arXiv preprint arXiv:2205.04382, 2022 - arxiv.org
We explore a novel method to perceive and manipulate 3D articulated objects that
generalizes to enable a robot to articulate unseen classes of objects. We propose a vision …

Joinable: Learning bottom-up assembly of parametric cad joints

KDD Willis, PK Jayaraman, H Chu… - Proceedings of the …, 2022 - openaccess.thecvf.com
Physical products are often complex assemblies combining a multitude of 3D parts modeled
in computer-aided design (CAD) software. CAD designers build up these assemblies by …

Vat-mart: Learning visual action trajectory proposals for manipulating 3d articulated objects

R Wu, Y Zhao, K Mo, Z Guo, Y Wang, T Wu… - arXiv preprint arXiv …, 2021 - arxiv.org
Perceiving and manipulating 3D articulated objects (eg, cabinets, doors) in human
environments is an important yet challenging task for future home-assistant robots. The …

Paris: Part-level reconstruction and motion analysis for articulated objects

J Liu, A Mahdavi-Amiri, M Savva - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
We address the task of simultaneous part-level reconstruction and motion parameter
estimation for articulated objects. Given two sets of multi-view images of an object in two …

Adaafford: Learning to adapt manipulation affordance for 3d articulated objects via few-shot interactions

Y Wang, R Wu, K Mo, J Ke, Q Fan, LJ Guibas… - European conference on …, 2022 - Springer
Perceiving and interacting with 3D articulated objects, such as cabinets, doors, and faucets,
pose particular challenges for future home-assistant robots performing daily tasks in human …