Nerfactor: Neural factorization of shape and reflectance under an unknown illumination

X Zhang, PP Srinivasan, B Deng, P Debevec… - ACM Transactions on …, 2021 - dl.acm.org
We address the problem of recovering the shape and spatially-varying reflectance of an
object from multi-view images (and their camera poses) of an object illuminated by one …

Differentiable monte carlo ray tracing through edge sampling

TM Li, M Aittala, F Durand, J Lehtinen - ACM Transactions on Graphics …, 2018 - dl.acm.org
Gradient-based methods are becoming increasingly important for computer graphics,
machine learning, and computer vision. The ability to compute gradients is crucial to …

Neural reflectance fields for appearance acquisition

S Bi, Z Xu, P Srinivasan, B Mildenhall… - arXiv preprint arXiv …, 2020 - arxiv.org
We present Neural Reflectance Fields, a novel deep scene representation that encodes
volume density, normal and reflectance properties at any 3D point in a scene using a fully …

Learning to reconstruct shape and spatially-varying reflectance from a single image

Z Li, Z Xu, R Ramamoorthi, K Sunkavalli… - ACM Transactions on …, 2018 - dl.acm.org
Reconstructing shape and reflectance properties from images is a highly under-constrained
problem, and has previously been addressed by using specialized hardware to capture …

Single-image svbrdf capture with a rendering-aware deep network

V Deschaintre, M Aittala, F Durand, G Drettakis… - ACM Transactions on …, 2018 - dl.acm.org
Texture, highlights, and shading are some of many visual cues that allow humans to
perceive material appearance in single pictures. Yet, recovering spatially-varying bi …

[PDF][PDF] Deep inverse rendering for high-resolution SVBRDF estimation from an arbitrary number of images.

D Gao, X Li, Y Dong, P Peers, K Xu… - ACM Trans. Graph., 2019 - gao-duan.github.io
Estimating the surface reflectance properties of a spatially-varying material is a challenging
problem. Methods based on inverse rendering (eg,[Dong et al. 2014; Hui et al. 2017]) can …

Deep reflectance volumes: Relightable reconstructions from multi-view photometric images

S Bi, Z Xu, K Sunkavalli, M Hašan… - Computer Vision–ECCV …, 2020 - Springer
We present a deep learning approach to reconstruct scene appearance from unstructured
images captured under collocated point lighting. At the heart of Deep Reflectance Volumes …

A survey of the state-of-the-art in patch-based synthesis

C Barnes, FL Zhang - Computational Visual Media, 2017 - Springer
This paper surveys the state-of-the-art of research in patch-based synthesis. Patch-based
methods synthesize output images by copying small regions from exemplar imagery. This …

Unified shape and svbrdf recovery using differentiable monte carlo rendering

F Luan, S Zhao, K Bala, Z Dong - Computer Graphics Forum, 2021 - Wiley Online Library
Reconstructing the shape and appearance of real‐world objects using measured 2D images
has been a long‐standing inverse rendering problem. In this paper, we introduce a new …

MaterialGAN: Reflectance capture using a generative SVBRDF model

Y Guo, C Smith, M Hašan, K Sunkavalli… - arXiv preprint arXiv …, 2020 - arxiv.org
We address the problem of reconstructing spatially-varying BRDFs from a small set of image
measurements. This is a fundamentally under-constrained problem, and previous work has …