Imuposer: Full-body pose estimation using imus in phones, watches, and earbuds

V Mollyn, R Arakawa, M Goel, C Harrison… - Proceedings of the 2023 …, 2023 - dl.acm.org
Tracking body pose on-the-go could have powerful uses in fitness, mobile gaming, context-
aware virtual assistants, and rehabilitation. However, users are unlikely to buy and wear …

Capturing complex hand movements and object interactions using machine learning-powered stretchable smart textile gloves

A Tashakori, Z Jiang, A Servati, S Soltanian… - Nature Machine …, 2024 - nature.com
Accurate real-time tracking of dexterous hand movements has numerous applications in
human–computer interaction, the metaverse, robotics and tele-health. Capturing realistic …

Wearsign: Pushing the limit of sign language translation using inertial and emg wearables

Q Zhang, JZ Jing, D Wang, R Zhao - … of the ACM on interactive, mobile …, 2022 - dl.acm.org
Sign language translation (SLT) is considered as the core technology to break the
communication barrier between the deaf and hearing people. However, most studies only …

EtherPose: Continuous hand pose tracking with wrist-worn antenna impedance characteristic sensing

D Kim, C Harrison - Proceedings of the 35th Annual ACM Symposium on …, 2022 - dl.acm.org
EtherPose is a continuous hand pose tracking system employing two wrist-worn antennas,
from which we measure the real-time dielectric loading resulting from different hand …

DualRing: Enabling subtle and expressive hand interaction with dual IMU rings

C Liang, C Yu, Y Qin, Y Wang, Y Shi - … of the ACM on Interactive, Mobile …, 2021 - dl.acm.org
We present DualRing, a novel ring-form input device that can capture the state and
movement of the user's hand and fingers. With two IMU rings attached to the user's thumb …

Force-aware interface via electromyography for natural VR/AR interaction

Y Zhang, B Liang, B Chen, PM Torrens… - ACM Transactions on …, 2022 - dl.acm.org
While tremendous advances in visual and auditory realism have been made for virtual and
augmented reality (VR/AR), introducing a plausible sense of physicality into the virtual world …

Echowrist: Continuous hand pose tracking and hand-object interaction recognition using low-power active acoustic sensing on a wristband

CJ Lee, R Zhang, D Agarwal, TC Yu, V Gunda… - Proceedings of the CHI …, 2024 - dl.acm.org
Our hands serve as a fundamental means of interaction with the world around us. Therefore,
understanding hand poses and interaction contexts is critical for human-computer …

Leveraging the properties of mmwave signals for 3d finger motion tracking for interactive iot applications

Y Liu, S Zhang, M Gowda, S Nelakuditi - Proceedings of the ACM on …, 2022 - dl.acm.org
mmWave signals form a critical component of 5G and next-generation wireless networks,
which are also being increasingly considered for sensing the environment around us to …

Enabling voice-accompanying hand-to-face gesture recognition with cross-device sensing

Z Li, C Liang, Y Wang, Y Qin, C Yu, Y Yan… - Proceedings of the …, 2023 - dl.acm.org
Gestures performed accompanying the voice are essential for voice interaction to convey
complementary semantics for interaction purposes such as wake-up state and input …

Learning on the rings: Self-supervised 3d finger motion tracking using wearable sensors

H Zhou, T Lu, Y Liu, S Zhang, M Gowda - Proceedings of the ACM on …, 2022 - dl.acm.org
This paper presents ssLOTR (self-supervised learning on the rings), a system that shows the
feasibility of designing self-supervised learning based techniques for 3D finger motion …