Mocap Everyone Everywhere: Lightweight Motion Capture With Smartwatches and a Head-Mounted Camera
We present a lightweight and affordable motion capture method based on two smartwatches
and a head-mounted camera. In contrast to the existing approaches that use six or more …
and a head-mounted camera. In contrast to the existing approaches that use six or more …
MANIKIN: biomechanically accurate neural inverse kinematics for human motion estimation
Mixed Reality systems aim to estimate a user's full-body joint configurations from just the
pose of the end effectors, primarily head and hand poses. Existing methods often involve …
pose of the end effectors, primarily head and hand poses. Existing methods often involve …
Physical non-inertial poser (pnp): Modeling non-inertial effects in sparse-inertial human motion capture
Existing inertial motion capture techniques use the human root coordinate frame to estimate
local poses and treat it as an inertial frame by default. We argue that when the root has …
local poses and treat it as an inertial frame by default. We argue that when the root has …
Biometrics in extended reality: a review
In the domain of Extended Reality (XR), particularly Virtual Reality (VR), extensive research
has been devoted to harnessing this transformative technology in various real-world …
has been devoted to harnessing this transformative technology in various real-world …
Real-Time Simulated Avatar from Head-Mounted Sensors
We present SimXR a method for controlling a simulated avatar from information (headset
pose and cameras) obtained from AR/VR headsets. Due to the challenging viewpoint of …
pose and cameras) obtained from AR/VR headsets. Due to the challenging viewpoint of …
A Unified Diffusion Framework for Scene-aware Human Motion Estimation from Sparse Signals
Estimating full-body human motion via sparse tracking signals from head-mounted displays
and hand controllers in 3D scenes is crucial to applications in AR/VR. One of the biggest …
and hand controllers in 3D scenes is crucial to applications in AR/VR. One of the biggest …
HMD-Poser: On-Device Real-time Human Motion Tracking from Scalable Sparse Observations
P Dai, Y Zhang, T Liu, Z Fan, T Du… - Proceedings of the …, 2024 - openaccess.thecvf.com
It is especially challenging to achieve real-time human motion tracking on a standalone VR
Head-Mounted Display (HMD) such as Meta Quest and PICO. In this paper we propose …
Head-Mounted Display (HMD) such as Meta Quest and PICO. In this paper we propose …
EnvPoser: Environment-aware Realistic Human Motion Estimation from Sparse Observations with Uncertainty Modeling
Estimating full-body motion using the tracking signals of head and hands from VR devices
holds great potential for various applications. However, the sparsity and unique distribution …
holds great potential for various applications. However, the sparsity and unique distribution …
ReliaAvatar: A Robust Real-Time Avatar Animator with Integrated Motion Prediction
Efficiently estimating the full-body pose with minimal wearable devices presents a
worthwhile research direction. Despite significant advancements in this field, most current …
worthwhile research direction. Despite significant advancements in this field, most current …