Differentiable rendering: A survey

H Kato, D Beker, M Morariu, T Ando… - arXiv preprint arXiv …, 2020 - arxiv.org
Deep neural networks (DNNs) have shown remarkable performance improvements on
vision-related tasks such as object detection or image segmentation. Despite their success …

Single image 3D object reconstruction based on deep learning: A review

K Fu, J Peng, Q He, H Zhang - Multimedia Tools and Applications, 2021 - Springer
The reconstruction of 3D object from a single image is an important task in the field of
computer vision. In recent years, 3D reconstruction of single image using deep learning …

Magic3d: High-resolution text-to-3d content creation

CH Lin, J Gao, L Tang, T Takikawa… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recently, DreamFusion demonstrated the utility of a pretrained text-to-image diffusion model
to optimize Neural Radiance Fields (NeRF), achieving remarkable text-to-3D synthesis …

Get3d: A generative model of high quality 3d textured shapes learned from images

J Gao, T Shen, Z Wang, W Chen… - Advances In …, 2022 - proceedings.neurips.cc
As several industries are moving towards modeling massive 3D virtual worlds, the need for
content creation tools that can scale in terms of the quantity, quality, and diversity of 3D …

Lion: Latent point diffusion models for 3d shape generation

A Vahdat, F Williams, Z Gojcic… - Advances in …, 2022 - proceedings.neurips.cc
Denoising diffusion models (DDMs) have shown promising results in 3D point cloud
synthesis. To advance 3D DDMs and make them useful for digital artists, we require (i) high …

Monosdf: Exploring monocular geometric cues for neural implicit surface reconstruction

Z Yu, S Peng, M Niemeyer, T Sattler… - Advances in neural …, 2022 - proceedings.neurips.cc
In recent years, neural implicit surface reconstruction methods have become popular for
multi-view 3D reconstruction. In contrast to traditional multi-view stereo methods, these …

3d neural field generation using triplane diffusion

JR Shue, ER Chan, R Po, Z Ankner… - Proceedings of the …, 2023 - openaccess.thecvf.com
Diffusion models have emerged as the state-of-the-art for image generation, among other
tasks. Here, we present an efficient diffusion-based model for 3D-aware generation of neural …

Sdfusion: Multimodal 3d shape completion, reconstruction, and generation

YC Cheng, HY Lee, S Tulyakov… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this work, we present a novel framework built to simplify 3D asset generation for amateur
users. To enable interactive generation, our method supports a variety of input modalities …

Petr: Position embedding transformation for multi-view 3d object detection

Y Liu, T Wang, X Zhang, J Sun - European Conference on Computer …, 2022 - Springer
In this paper, we develop position embedding transformation (PETR) for multi-view 3D
object detection. PETR encodes the position information of 3D coordinates into image …

[HTML][HTML] 3DFlex: determining structure and motion of flexible proteins from cryo-EM

A Punjani, DJ Fleet - Nature Methods, 2023 - nature.com
Modeling flexible macromolecules is one of the foremost challenges in single-particle
cryogenic-electron microscopy (cryo-EM), with the potential to illuminate fundamental …