Neural fields in visual computing and beyond

Y Xie, T Takikawa, S Saito, O Litany… - Computer Graphics …, 2022 - Wiley Online Library
Recent advances in machine learning have led to increased interest in solving visual
computing problems using methods that employ coordinate‐based neural networks. These …

Hyperdiffusion: Generating implicit neural fields with weight-space diffusion

Z Erkoç, F Ma, Q Shan, M Nießner… - Proceedings of the …, 2023 - openaccess.thecvf.com
Implicit neural fields, typically encoded by a multilayer perceptron (MLP) that maps from
coordinates (eg, xyz) to signals (eg, signed distances), have shown remarkable promise as …

From data to functa: Your data point is a function and you can treat it like one

E Dupont, H Kim, SM Eslami, D Rezende… - arXiv preprint arXiv …, 2022 - arxiv.org
It is common practice in deep learning to represent a measurement of the world on a
discrete grid, eg a 2D grid of pixels. However, the underlying signal represented by these …

3d concept learning and reasoning from multi-view images

Y Hong, C Lin, Y Du, Z Chen… - Proceedings of the …, 2023 - openaccess.thecvf.com
Humans are able to accurately reason in 3D by gathering multi-view observations of the
surrounding world. Inspired by this insight, we introduce a new large-scale benchmark for …

Pix2nerf: Unsupervised conditional p-gan for single image to neural radiance fields translation

S Cai, A Obukhov, D Dai… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
We propose a pipeline to generate Neural Radiance Fields (NeRF) of an object or a scene
of a specific class, conditioned on a single input image. This is a challenging task, as …

Clip-actor: Text-driven recommendation and stylization for animating human meshes

K Youwang, K Ji-Yeon, TH Oh - European Conference on Computer …, 2022 - Springer
We propose CLIP-Actor, a text-driven motion recommendation and neural mesh stylization
system for human mesh animation. CLIP-Actor animates a 3D human mesh to conform to a …

Learning neural acoustic fields

A Luo, Y Du, M Tarr, J Tenenbaum… - Advances in Neural …, 2022 - proceedings.neurips.cc
Our environment is filled with rich and dynamic acoustic information. When we walk into a
cathedral, the reverberations as much as appearance inform us of the sanctuary's wide open …

Implicit neural spatial representations for time-dependent pdes

H Chen, R Wu, E Grinspun, C Zheng… - … on Machine Learning, 2023 - proceedings.mlr.press
Abstract Implicit Neural Spatial Representation (INSR) has emerged as an effective
representation of spatially-dependent vector fields. This work explores solving time …

Crom: Continuous reduced-order modeling of pdes using implicit neural representations

PY Chen, J Xiang, DH Cho, Y Chang… - arXiv preprint arXiv …, 2022 - arxiv.org
The long runtime of high-fidelity partial differential equation (PDE) solvers makes them
unsuitable for time-critical applications. We propose to accelerate PDE solvers using …

Deep learning on implicit neural representations of shapes

L De Luigi, A Cardace, R Spezialetti… - arXiv preprint arXiv …, 2023 - arxiv.org
Implicit Neural Representations (INRs) have emerged in the last few years as a powerful tool
to encode continuously a variety of different signals like images, videos, audio and 3D …