Capturing and inferring dense full-body human-scene contact
Inferring human-scene contact (HSC) is the first step toward understanding how humans
interact with their surroundings. While detecting 2D human-object interaction (HOI) and …
interact with their surroundings. While detecting 2D human-object interaction (HOI) and …
Avatars grow legs: Generating smooth human motion from sparse tracking inputs with diffusion model
With the recent surge in popularity of AR/VR applications, realistic and accurate control of
3D full-body avatars has become a highly demanded feature. A particular challenge is that …
3D full-body avatars has become a highly demanded feature. A particular challenge is that …
Avatarposer: Articulated full-body pose tracking from sparse motion sensing
Abstract Today's Mixed Reality head-mounted displays track the user's head pose in world
space as well as the user's hands for interaction in both Augmented Reality and Virtual …
space as well as the user's hands for interaction in both Augmented Reality and Virtual …
Questsim: Human motion tracking from sparse sensors with simulated avatars
Real-time tracking of human body motion is crucial for interactive and immersive
experiences in AR/VR. However, very limited sensor data about the body is available from …
experiences in AR/VR. However, very limited sensor data about the body is available from …
Ego-body pose estimation via ego-head pose estimation
Estimating 3D human motion from an egocentric video sequence plays a critical role in
human behavior understanding and has various applications in VR/AR. However, naively …
human behavior understanding and has various applications in VR/AR. However, naively …
Transformer inertial poser: Real-time human motion reconstruction from sparse imus with simultaneous terrain generation
Real-time human motion reconstruction from a sparse set of (eg six) wearable IMUs
provides a non-intrusive and economic approach to motion capture. Without the ability to …
provides a non-intrusive and economic approach to motion capture. Without the ability to …
Flag: Flow-based 3d avatar generation from sparse observations
To represent people in mixed reality applications for collaboration and communication, we
need to generate realistic and faithful avatar poses. However, the signal streams that can be …
need to generate realistic and faithful avatar poses. However, the signal streams that can be …
Bodiffusion: Diffusing sparse observations for full-body human motion synthesis
Mixed reality applications require tracking the user's full-body motion to enable an
immersive experience. However, typical head-mounted devices can only track head and …
immersive experience. However, typical head-mounted devices can only track head and …
A Survey on 3D Egocentric Human Pose Estimation
Egocentric human pose estimation aims to estimate human body poses and develop body
representations from a first-person camera perspective. It has gained vast popularity in …
representations from a first-person camera perspective. It has gained vast popularity in …
Combining Motion Matching and Orientation Prediction to Animate Avatars for Consumer‐Grade VR Devices
The animation of user avatars plays a crucial role in conveying their pose, gestures, and
relative distances to virtual objects or other users. Self‐avatar animation in immersive VR …
relative distances to virtual objects or other users. Self‐avatar animation in immersive VR …