3d generative model latent disentanglement via local eigenprojection
Computer Graphics Forum, 2023•Wiley Online Library
Designing realistic digital humans is extremely complex. Most data‐driven generative
models used to simplify the creation of their underlying geometric shape do not offer control
over the generation of local shape attributes. In this paper, we overcome this limitation by
introducing a novel loss function grounded in spectral geometry and applicable to different
neural‐network‐based generative models of 3D head and body meshes. Encouraging the
latent variables of mesh variational autoencoders (VAEs) or generative adversarial networks …
models used to simplify the creation of their underlying geometric shape do not offer control
over the generation of local shape attributes. In this paper, we overcome this limitation by
introducing a novel loss function grounded in spectral geometry and applicable to different
neural‐network‐based generative models of 3D head and body meshes. Encouraging the
latent variables of mesh variational autoencoders (VAEs) or generative adversarial networks …
Abstract
Designing realistic digital humans is extremely complex. Most data‐driven generative models used to simplify the creation of their underlying geometric shape do not offer control over the generation of local shape attributes. In this paper, we overcome this limitation by introducing a novel loss function grounded in spectral geometry and applicable to different neural‐network‐based generative models of 3D head and body meshes. Encouraging the latent variables of mesh variational autoencoders (VAEs) or generative adversarial networks (GANs) to follow the local eigenprojections of identity attributes, we improve latent disentanglement and properly decouple the attribute creation. Experimental results show that our local eigenprojection disentangled (LED) models not only offer improved disentanglement with respect to the state‐of‐the‐art, but also maintain good generation capabilities with training times comparable to the vanilla implementations of the models. Our code and pre‐trained models are available at github.com/simofoti/LocalEigenprojDisentangled.
Wiley Online Library
以上显示的是最相近的搜索结果。 查看全部搜索结果