Neural fields in visual computing and beyond

Y Xie, T Takikawa, S Saito, O Litany… - Computer Graphics …, 2022 - Wiley Online Library
Recent advances in machine learning have led to increased interest in solving visual
computing problems using methods that employ coordinate‐based neural networks. These …

Advances in neural rendering

A Tewari, J Thies, B Mildenhall… - Computer Graphics …, 2022 - Wiley Online Library
Synthesizing photo‐realistic images and videos is at the heart of computer graphics and has
been the focus of decades of research. Traditionally, synthetic images of a scene are …

Im avatar: Implicit morphable head avatars from videos

Y Zheng, VF Abrevaya, MC Bühler… - Proceedings of the …, 2022 - openaccess.thecvf.com
Traditional 3D morphable face models (3DMMs) provide fine-grained control over
expression but cannot easily capture geometric and appearance details. Neural volumetric …

Gaussian head avatar: Ultra high-fidelity head avatar via dynamic gaussians

Y Xu, B Chen, Z Li, H Zhang, L Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Creating high-fidelity 3D head avatars has always been a research hotspot but there
remains a great challenge under lightweight sparse view setups. In this paper we propose …

Reconstructing personalized semantic facial nerf models from monocular video

X Gao, C Zhong, J Xiang, Y Hong, Y Guo… - ACM Transactions on …, 2022 - dl.acm.org
We present a novel semantic model for human head defined with neural radiance field. The
3D-consistent head model consist of a set of disentangled and interpretable bases, and can …

Avatarrex: Real-time expressive full-body avatars

Z Zheng, X Zhao, H Zhang, B Liu, Y Liu - ACM Transactions on Graphics …, 2023 - dl.acm.org
We present AvatarReX, a new method for learning NeRF-based full-body avatars from video
data. The learnt avatar not only provides expressive control of the body, hands and the face …

Generalizable patch-based neural rendering

M Suhail, C Esteves, L Sigal, A Makadia - European Conference on …, 2022 - Springer
Neural rendering has received tremendous attention since the advent of Neural Radiance
Fields (NeRF), and has pushed the state-of-the-art on novel-view synthesis considerably …

Learning dynamic facial radiance fields for few-shot talking head synthesis

S Shen, W Li, Z Zhu, Y Duan, J Zhou, J Lu - European conference on …, 2022 - Springer
Talking head synthesis is an emerging technology with wide applications in film dubbing,
virtual avatars and online education. Recent NeRF-based methods generate more natural …

Neural-gif: Neural generalized implicit functions for animating people in clothing

G Tiwari, N Sarafianos, T Tung… - Proceedings of the …, 2021 - openaccess.thecvf.com
Abstract We present Neural Generalized Implicit Functions (Neural-GIF), to animate people
in clothing as a function of the body pose. Given a sequence of scans of a subject in various …

X-avatar: Expressive human avatars

K Shen, C Guo, M Kaufmann… - Proceedings of the …, 2023 - openaccess.thecvf.com
We present X-Avatar, a novel avatar model that captures the full expressiveness of digital
humans to bring about life-like experiences in telepresence, AR/VR and beyond. Our …