Echowrist: Continuous hand pose tracking and hand-object interaction recognition using low-power active acoustic sensing on a wristband

CJ Lee, R Zhang, D Agarwal, TC Yu, V Gunda… - Proceedings of the CHI …, 2024 - dl.acm.org
Our hands serve as a fundamental means of interaction with the world around us. Therefore,
understanding hand poses and interaction contexts is critical for human-computer …

GazeTrak: Exploring Acoustic-based Eye Tracking on a Glass Frame

K Li, R Zhang, B Chen, S Chen, S Yin… - Proceedings of the 30th …, 2024 - dl.acm.org
In this paper, we present GazeTrak, the first acoustic-based eye tracking system on glasses.
Our system only needs one speaker and four microphones attached to each side of the …

ActSonic: Everyday Activity Recognition on Smart Glasses using Active Acoustic Sensing

S Mahmud, V Parikh, Q Liang, K Li, R Zhang… - arXiv preprint arXiv …, 2024 - arxiv.org
In this paper, we introduce ActSonic, an intelligent, low-power active acoustic sensing
system integrated into eyeglasses. ActSonic is designed to recognize 27 different everyday …

EyeGesener: Eye Gesture Listener for Smart Glasses Interaction Using Acoustic Sensing

T Sun, Y Zhao, W Xie, J Li, Y Ma, J Zhang - Proceedings of the ACM on …, 2024 - dl.acm.org
The smart glasses market has witnessed significant growth in recent years. The interaction
of commercial smart glasses mostly relies on the hand, which is unsuitable for scenarios …

SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Tracking

TC Yu, MM Zhang, P He, CJ Lee, C Cheesman… - Proceedings of the 37th …, 2024 - dl.acm.org
Seams are areas of overlapping fabric formed by stitching two or more pieces of fabric
together in the cut-and-sew apparel manufacturing process. In SeamPose, we repurposed …

MunchSonic: Tracking Fine-grained Dietary Actions through Active Acoustic Sensing on Eyeglasses

S Mahmud, D Agarwal, A Ajit, Q Liang… - Proceedings of the …, 2024 - dl.acm.org
We introduce MunchSonic, an AI-powered active acoustic sensing system integrated into
eyeglasses to track fine-grained dietary actions. MunchSonic emits inaudible ultrasonic …

Ring-a-Pose: A Ring for Continuous Hand Pose Tracking

TC Yu, G Hu, R Zhang, H Lim, S Mahmud… - arXiv preprint arXiv …, 2024 - arxiv.org
We present Ring-a-Pose, a single untethered ring that tracks continuous 3D hand poses.
Located in the center of the hand, the ring emits an inaudible acoustic signal that each hand …

Emotion Recognition in HMDs: A Multi-task Approach Using Physiological Signals and Occluded Faces

Y Pei, J Tang, Q Tang, M Zha, D Xie, G Wang… - ACM Multimedia …, 2024 - openreview.net
Prior research on emotion recognition in extended reality (XR) has faced challenges due to
the occlusion of facial expressions by Head-Mounted Displays (HMDs). This limitation …