State of the art in hand and finger modeling and animation

N Wheatland, Y Wang, H Song, M Neff… - Computer Graphics …, 2015 - Wiley Online Library
The human hand is a complex biological system able to perform numerous tasks with
impressive accuracy and dexterity. Gestures furthermore play an important role in our daily …

[HTML][HTML] Manipnet: neural manipulation synthesis with a hand-object spatial representation

M Zhang, Y Ye, T Shiratori, T Komura - 2021 - history.siggraph.org
Natural hand manipulations exhibit complex finger maneuvers adaptive to object shapes
and the tasks at hand. Learning dexterous manipulation from data in a brute force way …

Talking with hands 16.2 m: A large-scale dataset of synchronized body-finger motion and audio for conversational motion analysis and synthesis

G Lee, Z Deng, S Ma, T Shiratori… - Proceedings of the …, 2019 - openaccess.thecvf.com
Abstract We present a 16.2-million frame (50-hour) multimodal dataset of two-person face-to-
face spontaneous conversations. Our dataset features synchronized body and finger motion …

Body2hands: Learning to infer 3d hands from conversational gesture body dynamics

E Ng, S Ginosar, T Darrell… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
We propose a novel learned deep prior of body motion for 3D hand shape synthesis and
estimation in the domain of conversational gestures. Our model builds upon the insight that …

Real-time prosody-driven synthesis of body language

S Levine, C Theobalt, V Koltun - ACM SIGGRAPH Asia 2009 papers, 2009 - dl.acm.org
Human communication involves not only speech, but also a wide variety of gestures and
body motions. Interactions in virtual environments often lack this multi-modal aspect of …

Synthesis of detailed hand manipulations using contact sampling

Y Ye, CK Liu - ACM Transactions on Graphics (ToG), 2012 - dl.acm.org
Capturing human activities that involve both gross full-body motion and detailed hand
manipulation of objects is challenging for standard motion capture systems. We introduce a …

BOTH2Hands: Inferring 3D Hands from Both Text Prompts and Body Dynamics

W Zhang, M Huang, Y Zhou, J Zhang… - Proceedings of the …, 2024 - openaccess.thecvf.com
The recently emerging text-to-motion advances have spired numerous attempts for
convenient and interactive human motion generation. Yet existing methods are largely …

Dextrous manipulation from a grasping pose

CK Liu - ACM SIGGRAPH 2009 papers, 2009 - dl.acm.org
This paper introduces an optimization-based approach to synthesizing hand manipulations
from a starting grasping pose. We describe an automatic method that takes as input an initial …

Visual and physical motion sensing for three-dimensional motion capture

S Sullivan, K Wooley, BA Allen, M Sanders - US Patent 9,142,024, 2015 - Google Patents
(57) ABSTRACT A system includes a visual data collector for collecting visual information
from an image of one or more features of an object. The system also includes a physical …

Gesture unit segmentation using support vector machines: segmenting gestures from rest positions

RCB Madeo, CAM Lima, SM Peres - Proceedings of the 28th Annual …, 2013 - dl.acm.org
Gesture analysis has been widely used for developing new methods of human-computer
interaction. The advancement reached in the gesture analysis area is also motivating its …