CaptainCook4D: A dataset for understanding errors in procedural activities

R Peddi, S Arya, B Challa, L Pallapothula… - arXiv preprint arXiv …, 2023 - arxiv.org
Following step-by-step procedures is an essential component of various activities carried out
by individuals in their daily lives. These procedures serve as a guiding framework that helps …

Hand interaction designs in mixed and augmented reality head mounted display: a scoping review and classification

R Nguyen, C Gouin-Vallerand, M Amiri - Frontiers in Virtual Reality, 2023 - frontiersin.org
Mixed reality has made its first step towards democratization in 2017 with the launch of a first
generation of commercial devices. As a new medium, one of the challenges is to develop …

That Doesn't Go There: Attacks on Shared State in {Multi-User} Augmented Reality Applications

C Slocum, Y Zhang, E Shayegani, P Zaree… - 33rd USENIX Security …, 2024 - usenix.org
Augmented Reality (AR) can enable shared virtual experiences between multiple users. In
order to do so, it is crucial for multi-user AR applications to establish a consensus on the" …

Image-based Live Tracking and Registration for AR-Guided Liver Surgery Using Hololens2: A Phantom Study

S Khajarian, S Remmele, O Amft - 2023 IEEE EMBS …, 2023 - ieeexplore.ieee.org
We investigate AR-based tracking and registration of the liver surface for potential surgical
applications. Our approach consists of streaming RGBD data from a Hololens2 device …

Simulated augmented reality-based calibration of optical see-through head mound display for surgical navigation

HG Ha, K Gu, D Jeung, J Hong, H Lee - International Journal of Computer …, 2024 - Springer
Purpose Calibration of an optical see-through head-mounted display is critical for
augmented reality-based surgical navigation. While conventional methods have advanced …

Combining HoloLens with instant-NeRFs: Advanced real-time 3D mobile mapping

D Haitz, B Jutzi, M Ulrich, M Jäger… - arXiv preprint arXiv …, 2023 - arxiv.org
This work represents a large step into modern ways of fast 3D reconstruction based on RGB
camera images. Utilizing a Microsoft HoloLens 2 as a multisensor platform that includes an …

MRLabeling: Create RGB-D Datasets On-The-Fly using Mixed Reality

R Nguyen, R Baghezza, B Georges… - … on Mixed and …, 2023 - ieeexplore.ieee.org
One of the best ways to build better vision models is to train large models on big datasets.
However, the process of building such datasets is often costly and tedious. With the ever …

Estimating mechanical properties of soft objects using surface measurements from AR headsets

M Dang Vu, GD Maso Talou, H Bai… - Proceedings of the 29th …, 2023 - dl.acm.org
Physics-driven predictions of soft tissue mechanics are vital for various medical
interventions. Insights on the mechanical properties of soft tissues are essential for obtaining …

Smart Automatic Mixed Reality-Based Construction Inspection Framework

B Tao, J Li, F Bosché - ISARC. Proceedings of the …, 2024 - search.proquest.com
With increasingly complex construction projects, improving inspection efficiency and
accuracy is an important challenge. This paper proposes a novel MR-based construction …

Distributed edge computing for cooperative augmented reality: enhancing mobile sensing capabilities

CY Cheng, Q Zhao, CY Wu, Y Yang… - … and Systems for …, 2024 - spiedigitallibrary.org
Cooperative Augmented Reality (AR) can provide real-time, immersive, and context-aware
situational awareness while enhancing mobile sensing capabilities and benefiting various …