Real-time illumination and visual coherence for photorealistic augmented/mixed reality

AA Alhakamy, M Tuceryan - ACM Computing Surveys (CSUR), 2020 - dl.acm.org
A realistically inserted virtual object in the real-time physical environment is a desirable
feature in augmented reality (AR) applications and mixed reality (MR) in general. This …

Use of 3-dimensional modeling and augmented/virtual reality applications in microsurgical neuroanatomy training

SO Aydin, O Barut, MO Yilmaz, B Sahin… - Operative …, 2023 - journals.lww.com
BACKGROUND: Understanding the microsurgical neuroanatomy of the brain is challenging
yet crucial for safe and effective surgery. Training on human cadavers provides an …

Inpaintfusion: Incremental rgb-d inpainting for 3d scenes

S Mori, O Erat, W Broll, H Saito… - … on Visualization and …, 2020 - ieeexplore.ieee.org
State-of-the-art methods for diminished reality propagate pixel information from a keyframe
to subsequent frames for real-time inpainting. However, these approaches produce artifacts …

Natural environment illumination: Coherent interactive augmented reality for mobile and non-mobile devices

K Rohmer, J Jendersie, T Grosch - IEEE transactions on …, 2017 - ieeexplore.ieee.org
Augmented Reality offers many applications today, especially on mobile devices. Due to the
lack of mobile hardware for illumination measurements, photorealistic rendering with …

Reconstructing reflection maps using a stacked-CNN for mixed reality rendering

A Chalmers, J Zhao, D Medeiros… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Corresponding lighting and reflectance between real and virtual objects is important for
spatial presence in augmented and mixed reality (AR and MR) applications. We present a …

Interactive mixed reality rendering on holographic pyramid

D Dai, X Shi, L Wang, X Li - … on Virtual Reality and 3D User …, 2022 - ieeexplore.ieee.org
Currently, ray tracing and image-based lighting (IBL) have shortcomings when rendering the
metallic virtual object displayed in the holographic pyramid in mixed reality. Ray tracing can …

AR360: dynamic illumination for augmented reality with real-time interaction

M Tuceryan - 2019 IEEE 2nd International Conference on …, 2019 - ieeexplore.ieee.org
Current augmented and mixed reality systems suffer a lack of correct illumination modeling
where the virtual objects render the same lighting condition as the real environment. While …

Synthesis of environment maps for mixed reality

DR Walton, D Thomas, A Steed… - 2017 IEEE International …, 2017 - ieeexplore.ieee.org
When rendering virtual objects in a mixed reality application, it is helpful to have access to
an environment map that captures the appearance of the scene from the perspective of the …

CubeMap360: interactive global illumination for augmented reality in dynamic environment

M Tuceryan - 2019 SoutheastCon, 2019 - ieeexplore.ieee.org
Most augmented/mixed reality (AR/MR) applications still have shortcomings when
integrating virtual objects correctly in real scenes such that virtual objects are …

Delta Path Tracing for Real-Time Global Illumination in Mixed Reality

Y Xu, Y Jiang, S Wang, K Li… - 2023 IEEE Conference …, 2023 - ieeexplore.ieee.org
Visual coherence between real and virtual objects is important in mixed reality (MR), and
illumination consistency is one of the key aspects to achieve coherence. Apart from …