Decomposing 3d scenes into objects via unsupervised volume segmentation

K Stelzner, K Kersting, AR Kosiorek - arXiv preprint arXiv:2104.01148, 2021 - arxiv.org
We present ObSuRF, a method which turns a single image of a scene into a 3D model
represented as a set of Neural Radiance Fields (NeRFs), with each NeRF corresponding to …

Unsupervised discovery of object radiance fields

HX Yu, LJ Guibas, J Wu - arXiv preprint arXiv:2107.07905, 2021 - arxiv.org
We study the problem of inferring an object-centric scene representation from a single
image, aiming to derive a representation that explains the image formation process …

Nerf-sos: Any-view self-supervised object segmentation on complex scenes

Z Fan, P Wang, Y Jiang, X Gong, D Xu… - arXiv preprint arXiv …, 2022 - arxiv.org
Neural volumetric representations have shown the potential that Multi-layer Perceptrons
(MLPs) can be optimized with multi-view calibrated images to represent scene geometry and …

Instance neural radiance field

Y Liu, B Hu, J Huang, YW Tai… - Proceedings of the …, 2023 - openaccess.thecvf.com
This paper presents one of the first learning-based NeRF 3D instance segmentation
pipelines, dubbed as Instance Neural Radiance Field, or Instance-NeRF. Taking a NeRF …

Nesf: Neural semantic fields for generalizable semantic segmentation of 3d scenes

S Vora, N Radwan, K Greff, H Meyer, K Genova… - arXiv preprint arXiv …, 2021 - arxiv.org
We present NeSF, a method for producing 3D semantic fields from posed RGB images
alone. In place of classical 3D representations, our method builds on recent work in implicit …

Unsupervised multi-view object segmentation using radiance field propagation

X Liu, J Chen, H Yu, YW Tai… - Advances in Neural …, 2022 - proceedings.neurips.cc
We present radiance field propagation (RFP), a novel approach to segmenting objects in 3D
during reconstruction given only unlabeled multi-view images of a scene. RFP is derived …

Fig-nerf: Figure-ground neural radiance fields for 3d object category modelling

C Xie, K Park, R Martin-Brualla… - … Conference on 3D …, 2021 - ieeexplore.ieee.org
We investigate the use of Neural Radiance Fields (NeRF) to learn high quality 3D object
category models from collections of input images. In contrast to previous work, we are able …

Dm-nerf: 3d scene geometry decomposition and manipulation from 2d images

B Wang, L Chen, B Yang - arXiv preprint arXiv:2208.07227, 2022 - arxiv.org
In this paper, we study the problem of 3D scene geometry decomposition and manipulation
from 2D views. By leveraging the recent implicit neural representation techniques …

Omniseg3d: Omniversal 3d segmentation via hierarchical contrastive learning

H Ying, Y Yin, J Zhang, F Wang, T Yu… - Proceedings of the …, 2024 - openaccess.thecvf.com
Towards holistic understanding of 3D scenes a general 3D segmentation method is needed
that can segment diverse objects without restrictions on object quantity or categories while …

Neural volumetric object selection

Z Ren, A Agarwala, B Russell… - Proceedings of the …, 2022 - openaccess.thecvf.com
We introduce an approach for selecting objects in neural volumetric 3D representations,
such as multi-plane images (MPI) and neural radiance fields (NeRF). Our approach takes a …