Deepcap: Monocular human performance capture using weak supervision

M Habermann, W Xu, M Zollhofer… - Proceedings of the …, 2020 - openaccess.thecvf.com
Human performance capture is a highly important computer vision problem with many
applications in movie production and virtual/augmented reality. Many previous performance …

Scalable muscle-actuated human simulation and control

S Lee, M Park, K Lee, J Lee - ACM Transactions On Graphics (TOG), 2019 - dl.acm.org
Many anatomical factors, such as bone geometry and muscle condition, interact to affect
human movements. This work aims to build a comprehensive musculoskeletal model and its …

From skin to skeleton: Towards biomechanically accurate 3d digital humans

M Keller, K Werling, S Shin, S Delp, S Pujades… - ACM Transactions on …, 2023 - dl.acm.org
Great progress has been made in estimating 3D human pose and shape from images and
video by training neural networks to directly regress the parameters of parametric human …

Livecap: Real-time human performance capture from monocular video

M Habermann, W Xu, M Zollhoefer… - ACM Transactions On …, 2019 - dl.acm.org
We present the first real-time human performance capture approach that reconstructs dense,
space-time coherent deforming geometry of entire humans in general everyday clothing …

OSSO: Obtaining skeletal shape from outside

M Keller, S Zuffi, MJ Black… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
We address the problem of inferring the anatomic skeleton of a person, in an arbitrary pose,
from the 3D surface of the body; ie we predict the inside (bones) from the outside (skin). This …

Constraining dense hand surface tracking with elasticity

B Smith, C Wu, H Wen, P Peluse, Y Sheikh… - ACM Transactions on …, 2020 - dl.acm.org
Many of the actions that we take with our hands involve self-contact and occlusion: shaking
hands, making a fist, or interlacing our fingers while thinking. This use of of our hands …

Phace: Physics-based face modeling and animation

AE Ichim, P Kadleček, L Kavan, M Pauly - ACM Transactions on …, 2017 - dl.acm.org
We present a novel physics-based approach to facial animation. Contrary to commonly used
generative methods, our solution computes facial expressions by minimizing a set of non …

Nimble: a non-rigid hand model with bones and muscles

Y Li, L Zhang, Z Qiu, Y Jiang, N Li, Y Ma… - ACM Transactions on …, 2022 - dl.acm.org
Emerging Metaverse applications demand reliable, accurate, and photorealistic
reproductions of human hands to perform sophisticated operations as if in the physical …

SoftSMPL: Data‐driven Modeling of Nonlinear Soft‐tissue Dynamics for Parametric Humans

I Santesteban, E Garces, MA Otaduy… - Computer Graphics …, 2020 - Wiley Online Library
We present SoftSMPL, a learning‐based method to model realistic soft‐tissue dynamics as a
function of body shape and motion. Datasets to learn such task are scarce and expensive to …

The virtual caliper: rapid creation of metrically accurate avatars from 3D measurements

S Pujades, B Mohler, A Thaler, J Tesch… - IEEE transactions on …, 2019 - ieeexplore.ieee.org
Creating metrically accurate avatars is important for many applications such as virtual
clothing try-on, ergonomics, medicine, immersive social media, telepresence, and gaming …