Neural illumination: Lighting prediction for indoor environments

S Song, T Funkhouser - … of the IEEE/CVF Conference on …, 2019 - openaccess.thecvf.com
This paper addresses the task of estimating the light arriving from all directions to a 3D point
observed at a selected pixel in an RGB image. This task is challenging because it requires …

Inverse rendering for complex indoor scenes: Shape, spatially-varying lighting and svbrdf from a single image

Z Li, M Shafiei, R Ramamoorthi… - Proceedings of the …, 2020 - openaccess.thecvf.com
We propose a deep inverse rendering framework for indoor scenes. From a single RGB
image of an arbitrary indoor scene, we obtain a complete scene reconstruction, estimating …

Learning to reconstruct shape and spatially-varying reflectance from a single image

Z Li, Z Xu, R Ramamoorthi, K Sunkavalli… - ACM Transactions on …, 2018 - dl.acm.org
Reconstructing shape and reflectance properties from images is a highly under-constrained
problem, and has previously been addressed by using specialized hardware to capture …

Deep image-based relighting from optimal sparse samples

Z Xu, K Sunkavalli, S Hadap… - ACM Transactions on …, 2018 - dl.acm.org
We present an image-based relighting method that can synthesize scene appearance under
novel, distant illumination from the visible hemisphere, from only five images captured under …

Deep parametric indoor lighting estimation

MA Gardner, Y Hold-Geoffroy… - Proceedings of the …, 2019 - openaccess.thecvf.com
We present a method to estimate lighting from a single image of an indoor scene. Previous
work has used an environment map representation that does not account for the localized …

Fast spatially-varying indoor lighting estimation

M Garon, K Sunkavalli, S Hadap… - Proceedings of the …, 2019 - openaccess.thecvf.com
We propose a real-time method to estimate spatially-varying indoor lighting from a single
RGB image. Given an image and a 2D location in that image, our CNN estimates a 5th order …

Deep sky modeling for single image outdoor lighting estimation

Y Hold-Geoffroy, A Athawale… - Proceedings of the …, 2019 - openaccess.thecvf.com
We propose a data-driven learned sky model, which we use for outdoor lighting estimation
from a single image. As no large-scale dataset of images and their corresponding ground …

Orca: Glossy objects as radiance-field cameras

K Tiwary, A Dave, N Behari… - Proceedings of the …, 2023 - openaccess.thecvf.com
Reflections on glossy objects contain valuable and hidden information about the
surrounding environment. By converting these objects into cameras, we can unlock exciting …

Lime: Live intrinsic material estimation

A Meka, M Maximov, M Zollhoefer… - Proceedings of the …, 2018 - openaccess.thecvf.com
We present the first end-to-end approach for real-time material estimation for general object
shapes with uniform material that only requires a single color image as input. In addition to …

Relightable neural human assets from multi-view gradient illuminations

T Zhou, K He, D Wu, T Xu, Q Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Human modeling and relighting are two fundamental problems in computer vision and
graphics, where high-quality datasets can largely facilitate related research. However, most …