[HTML][HTML] Real-time radiance fields for single-image portrait view synthesis

A Trevithick, M Chan, M Stengel, E Chan, C Liu, Z Yu… - 2023 - history.siggraph.org
We present a one-shot method to infer and render a photorealistic 3D representation from a
single unposed image (eg, face portrait) in real-time. Given a single RGB input, our image …

Learning detailed radiance manifolds for high-fidelity and 3d-consistent portrait synthesis from monocular image

Y Deng, B Wang, HY Shum - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
A key challenge for novel view synthesis of monocular portrait images is 3D consistency
under continuous pose variations. Most existing methods rely on 2D generative models …

Fenerf: Face editing in neural radiance fields

J Sun, X Wang, Y Zhang, X Li… - Proceedings of the …, 2022 - openaccess.thecvf.com
Previous portrait image generation methods roughly fall into two categories: 2D GANs and
3D-aware GANs. 2D GANs can generate high fidelity portraits but with low view consistency …

Vision transformer for nerf-based view synthesis from a single input image

KE Lin, YC Lin, WS Lai, TY Lin… - Proceedings of the …, 2023 - openaccess.thecvf.com
Although neural radiance fields (NeRF) have shown impressive advances in novel view
synthesis, most methods require multiple input images of the same scene with accurate …

Nex: Real-time view synthesis with neural basis expansion

S Wizadwongsa, P Phongthawee… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present NeX, a new approach to novel view synthesis based on enhancements of
multiplane image (MPI) that can reproduce next-level view-dependent effects--in real time …

Nelf: Neural light-transport field for portrait view synthesis and relighting

T Sun, KE Lin, S Bi, Z Xu, R Ramamoorthi - arXiv preprint arXiv …, 2021 - arxiv.org
Human portraits exhibit various appearances when observed from different views under
different lighting conditions. We can easily imagine how the face will look like in another …

Neural radiance fields from sparse rgb-d images for high-quality view synthesis

YJ Yuan, YK Lai, YH Huang… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
The recently proposed neural radiance fields (NeRF) use a continuous function formulated
as a multi-layer perceptron (MLP) to model the appearance and geometry of a 3D scene …

Neural lumigraph rendering

P Kellnhofer, LC Jebe, A Jones… - Proceedings of the …, 2021 - openaccess.thecvf.com
Novel view synthesis is a challenging and ill-posed inverse rendering problem. Neural
rendering techniques have recently achieved photorealistic image quality for this task. State …

Diner: Depth-aware image-based neural radiance fields

M Prinzler, O Hilliges, J Thies - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Abstract We present Depth-aware Image-based NEural Radiance fields (DINER). Given a
sparse set of RGB input views, we predict depth and feature maps to guide the …

Regnerf: Regularizing neural radiance fields for view synthesis from sparse inputs

M Niemeyer, JT Barron, B Mildenhall… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract Neural Radiance Fields (NeRF) have emerged as a powerful representation for the
task of novel view synthesis due to their simplicity and state-of-the-art performance. Though …