Diffusion-guided reconstruction of everyday hand-object interaction clips

Y Ye, P Hebbar, A Gupta… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
We tackle the task of reconstructing hand-object interactions from short video clips. Given an
input video, our approach casts 3D inference as a per-video optimization and recovers a …

[HTML][HTML] An outlook into the future of egocentric vision

C Plizzari, G Goletto, A Furnari, S Bansal… - International Journal of …, 2024 - Springer
What will the future be? We wonder! In this survey, we explore the gap between current
research in egocentric vision and the ever-anticipated future, where wearable computing …

Moho: Learning single-view hand-held object reconstruction with multi-view occlusion-aware supervision

C Zhang, G Jiao, Y Di, G Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Previous works concerning single-view hand-held object reconstruction typically rely on
supervision from 3D ground-truth models which are hard to collect in real world. In contrast …

A survey of deep learning methods and datasets for hand pose estimation from hand-object interaction images

T Woo, W Park, W Jeong, J Park - Computers & Graphics, 2023 - Elsevier
The research topic of estimating hand pose from the images of hand-object interaction has
the potential for replicating natural hand behavior in many practical applications of virtual …

G-HOP: Generative Hand-Object Prior for Interaction Reconstruction and Grasp Synthesis

Y Ye, A Gupta, K Kitani… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
We propose G-HOP a denoising diffusion based generative prior for hand-object
interactions that allows modeling both the 3D object and a human hand conditioned on the …

Hoisdf: Constraining 3d hand-object pose estimation with global signed distance fields

H Qi, C Zhao, M Salzmann, A Mathis - arXiv preprint arXiv:2402.17062, 2024 - arxiv.org
Human hands are highly articulated and versatile at handling objects. Jointly estimating the
3D poses of a hand and the object it manipulates from a monocular camera is challenging …

MS-MANO: Enabling Hand Pose Tracking with Biomechanical Constraints

P Xie, W Xu, T Tang, Z Yu, C Lu - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
This work proposes a novel learning framework for visual hand dynamics analysis that takes
into account the physiological aspects of hand motion. The existing models which are …

Sparse multi-view hand-object reconstruction for unseen environments

YL Pang, C Oh, A Cavallaro - Proceedings of the IEEE/CVF …, 2024 - openaccess.thecvf.com
Recent works in hand-object reconstruction mainly focus on the single-view and dense multi-
view settings. On the one hand single-view methods can leverage learned shape priors to …

HACD: Hand-Aware Conditional Diffusion for Monocular Hand-Held Object Reconstruction

B Fu, Y Di, C Zhang, G Wang, Z Huang, Z Leng… - arXiv preprint arXiv …, 2023 - arxiv.org
Reconstructing hand-held objects from a single RGB image without known 3D object
templates, category prior, or depth information is a vital yet challenging problem in computer …

Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objects

Z Fan, T Ohkawa, L Yang, N Lin, Z Zhou, S Zhou… - arXiv preprint arXiv …, 2024 - arxiv.org
We interact with the world with our hands and see it through our own (egocentric)
perspective. A holistic 3D understanding of such interactions from egocentric views is …