Differentiable rendering: A survey

H Kato, D Beker, M Morariu, T Ando… - arXiv preprint arXiv …, 2020 - arxiv.org
Deep neural networks (DNNs) have shown remarkable performance improvements on
vision-related tasks such as object detection or image segmentation. Despite their success …

Animatable neural radiance fields for modeling dynamic human bodies

S Peng, J Dong, Q Wang, S Zhang… - Proceedings of the …, 2021 - openaccess.thecvf.com
This paper addresses the challenge of reconstructing an animatable human model from a
multi-view video. Some recent works have proposed to decompose a non-rigidly deforming …

Neural body: Implicit neural representations with structured latent codes for novel view synthesis of dynamic humans

S Peng, Y Zhang, Y Xu, Q Wang… - Proceedings of the …, 2021 - openaccess.thecvf.com
This paper addresses the challenge of novel view synthesis for a human performer from a
very sparse set of camera views. Some recent works have shown that learning implicit …

Structured local radiance fields for human avatar modeling

Z Zheng, H Huang, T Yu, H Zhang… - Proceedings of the …, 2022 - openaccess.thecvf.com
It is extremely challenging to create an animatable clothed human avatar from RGB videos,
especially for loose clothes due to the difficulties in motion modeling. To address this …

Function4d: Real-time human volumetric capture from very sparse consumer rgbd sensors

T Yu, Z Zheng, K Guo, P Liu… - Proceedings of the …, 2021 - openaccess.thecvf.com
Human volumetric capture is a long-standing topic in computer vision and computer
graphics. Although high-quality results can be achieved using sophisticated off-line systems …

Pifuhd: Multi-level pixel-aligned implicit function for high-resolution 3d human digitization

S Saito, T Simon, J Saragih… - Proceedings of the IEEE …, 2020 - openaccess.thecvf.com
Recent advances in image-based 3D human shape estimation have been driven by the
significant improvement in representation power afforded by deep neural networks …

Arch++: Animation-ready clothed human reconstruction revisited

T He, Y Xu, S Saito, S Soatto… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
We present ARCH++, an image-based method to reconstruct 3D avatars with arbitrary
clothing styles. Our reconstructed avatars are animation-ready and highly realistic, in both …

Photorealistic monocular 3d reconstruction of humans wearing clothing

T Alldieck, M Zanfir… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
We present PHORHUM, a novel, end-to-end trainable, deep neural network methodology for
photorealistic 3D human reconstruction given just a monocular RGB image. Our pixel …

Pifu: Pixel-aligned implicit function for high-resolution clothed human digitization

S Saito, Z Huang, R Natsume… - Proceedings of the …, 2019 - openaccess.thecvf.com
Abstract We introduce Pixel-aligned Implicit Function (PIFu), an implicit representation that
locally aligns pixels of 2D images with the global context of their corresponding 3D object …

Neural human performer: Learning generalizable radiance fields for human performance rendering

Y Kwon, D Kim, D Ceylan… - Advances in Neural …, 2021 - proceedings.neurips.cc
In this paper, we aim at synthesizing a free-viewpoint video of an arbitrary human
performance using sparse multi-view cameras. Recently, several works have addressed this …