Relightful Harmonization: Lighting-aware Portrait Background Replacement

M Ren, W Xiong, JS Yoon, Z Shu… - Proceedings of the …, 2024 - openaccess.thecvf.com
Portrait harmonization aims to composite a subject into a new background adjusting its
lighting and color to ensure harmony with the background scene. Existing harmonization …

URAvatar: Universal Relightable Gaussian Codec Avatars

J Li, C Cao, G Schwartz, R Khirodkar… - SIGGRAPH Asia 2024 …, 2024 - dl.acm.org
We present a new approach to creating photorealistic and relightable head avatars from a
phone scan with unknown illumination. The reconstructed avatars can be animated and relit …

Generative Portrait Shadow Removal

JS Yoon, Z Shu, M Ren, C Zhang… - ACM Transactions on …, 2024 - dl.acm.org
We introduce a high-fidelity portrait shadow removal model that can effectively enhance the
image of a portrait by predicting its appearance under disturbing shadows and highlights …

DifFRelight: Diffusion-Based Facial Performance Relighting

M He, P Clausen, AL Taşel, L Ma, O Pilarski… - SIGGRAPH Asia 2024 …, 2024 - dl.acm.org
We present a novel framework for free-viewpoint facial performance relighting using
diffusion-based image-to-image translation. Leveraging a subject-specific dataset …

RelitLRM: Generative Relightable Radiance for Large Reconstruction Models

T Zhang, Z Kuang, H Jin, Z Xu, S Bi, H Tan… - arXiv preprint arXiv …, 2024 - arxiv.org
We propose RelitLRM, a Large Reconstruction Model (LRM) for generating high-quality
Gaussian splatting representations of 3D objects under novel illuminations from sparse (4-8) …

Text2Relight: Creative Portrait Relighting with Text Guidance

J Cha, M Ren, KK Singh, H Zhang… - arXiv preprint arXiv …, 2024 - arxiv.org
We present a lighting-aware image editing pipeline that, given a portrait image and a text
prompt, performs single image relighting. Our model modifies the lighting and color of both …

LumiSculpt: A Consistency Lighting Control Network for Video Generation

Y Zhang, D Zheng, B Gong, J Chen, M Yang… - arXiv preprint arXiv …, 2024 - arxiv.org
Lighting plays a pivotal role in ensuring the naturalness of video generation, significantly
influencing the aesthetic quality of the generated content. However, due to the deep …

Interactive Rendering of Relightable and Animatable Gaussian Avatars

Y Zhan, T Shao, H Wang, Y Yang, K Zhou - arXiv preprint arXiv …, 2024 - arxiv.org
Creating relightable and animatable avatars from multi-view or monocular videos is a
challenging task for digital human creation and virtual reality applications. Previous methods …

Cas-FNE: Cascaded Face Normal Estimation

M Wang, J Zhang, J Ma, X Guo - IEEE/CAA Journal of …, 2024 - ieeexplore.ieee.org
Capturing high-fidelity normals from single face images plays a core role in numerous
computer vision and graphics applications. Though significant progress has been made in …