Mocap Everyone Everywhere: Lightweight Motion Capture With Smartwatches and a Head-Mounted Camera

J Lee, H Joo - Proceedings of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
We present a lightweight and affordable motion capture method based on two smartwatches
and a head-mounted camera. In contrast to the existing approaches that use six or more …

MANIKIN: biomechanically accurate neural inverse kinematics for human motion estimation

J Jiang, P Streli, X Luo, C Gebhardt, C Holz - European Conference on …, 2025 - Springer
Mixed Reality systems aim to estimate a user's full-body joint configurations from just the
pose of the end effectors, primarily head and hand poses. Existing methods often involve …

Physical non-inertial poser (pnp): Modeling non-inertial effects in sparse-inertial human motion capture

X Yi, Y Zhou, F Xu - ACM SIGGRAPH 2024 Conference Papers, 2024 - dl.acm.org
Existing inertial motion capture techniques use the human root coordinate frame to estimate
local poses and treat it as an inertial frame by default. We argue that when the root has …

Biometrics in extended reality: a review

A Agarwal, R Ramachandra, S Venkatesh… - Discover Artificial …, 2024 - Springer
In the domain of Extended Reality (XR), particularly Virtual Reality (VR), extensive research
has been devoted to harnessing this transformative technology in various real-world …

Real-Time Simulated Avatar from Head-Mounted Sensors

Z Luo, J Cao, R Khirodkar, A Winkler… - Proceedings of the …, 2024 - openaccess.thecvf.com
We present SimXR a method for controlling a simulated avatar from information (headset
pose and cameras) obtained from AR/VR headsets. Due to the challenging viewpoint of …

A Unified Diffusion Framework for Scene-aware Human Motion Estimation from Sparse Signals

J Tang, J Wang, K Ji, L Xu, J Yu… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Estimating full-body human motion via sparse tracking signals from head-mounted displays
and hand controllers in 3D scenes is crucial to applications in AR/VR. One of the biggest …

HMD-Poser: On-Device Real-time Human Motion Tracking from Scalable Sparse Observations

P Dai, Y Zhang, T Liu, Z Fan, T Du… - Proceedings of the …, 2024 - openaccess.thecvf.com
It is especially challenging to achieve real-time human motion tracking on a standalone VR
Head-Mounted Display (HMD) such as Meta Quest and PICO. In this paper we propose …

EnvPoser: Environment-aware Realistic Human Motion Estimation from Sparse Observations with Uncertainty Modeling

S Xia, Y Zhang, Z Su, X Zheng, Z Lv, G Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
Estimating full-body motion using the tracking signals of head and hands from VR devices
holds great potential for various applications. However, the sparsity and unique distribution …

ReliaAvatar: A Robust Real-Time Avatar Animator with Integrated Motion Prediction

B Qian, Z Wei, J Li, X Wei - arXiv preprint arXiv:2407.02129, 2024 - arxiv.org
Efficiently estimating the full-body pose with minimal wearable devices presents a
worthwhile research direction. Despite significant advancements in this field, most current …