Face-Mic: inferring live speech and speaker identity via subtle facial dynamics captured by AR/VR motion sensors

C Shi, X Xu, T Zhang, P Walker, Y Wu, J Liu… - Proceedings of the 27th …, 2021 - dl.acm.org
Augmented reality/virtual reality (AR/VR) has extended beyond 3D immersive gaming to a
broader array of applications, such as shopping, tourism, education. And recently there has …

Earbuddy: Enabling on-face interaction via wireless earbuds

X Xu, H Shi, X Yi, WJ Liu, Y Yan, Y Shi… - Proceedings of the …, 2020 - dl.acm.org
Past research regarding on-body interaction typically requires custom sensors, limiting their
scalability and generalizability. We propose EarBuddy, a real-time system that leverages the …

mmecho: A mmwave-based acoustic eavesdropping method

P Hu, W Li, R Spolaor, X Cheng - Proceedings of the ACM Turing Award …, 2023 - dl.acm.org
Acoustic eavesdropping on private or confidential spaces poses a significant privacy threat.
While soundproof rooms can mitigate these risks to some extent, they are unable to counter …

Echowhisper: Exploring an acoustic-based silent speech interface for smartphone users

Y Gao, Y Jin, J Li, S Choi, Z Jin - Proceedings of the ACM on Interactive …, 2020 - dl.acm.org
With the rapid growth of artificial intelligence and mobile computing, intelligent speech
interface has recently become one of the prevalent trends and has already presented huge …

Soundlip: Enabling word and sentence-level lip interaction for smart devices

Q Zhang, D Wang, R Zhao, Y Yu - Proceedings of the ACM on Interactive …, 2021 - dl.acm.org
As a natural and convenient interaction modality, voice input has now become
indispensable to smart devices (eg mobile phones and smart appliances). However, voice …

Ultraspeech: Speech enhancement by interaction between ultrasound and speech

H Ding, Y Wang, H Li, C Zhao, G Wang, W Xi… - Proceedings of the ACM …, 2022 - dl.acm.org
Speech enhancement can benefit lots of practical voice-based interaction applications,
where the goal is to generate clean speech from noisy ambient conditions. This paper …

[HTML][HTML] Applications and user perceptions of smart glasses in emergency medical services: semistructured interview study

Z Zhang, K Joy, R Harris, M Ozkaynak… - JMIR Human …, 2022 - humanfactors.jmir.org
Background: Smart glasses have been gaining momentum as a novel technology because
of their advantages in enabling hands-free operation and see-what-I-see remote …

[HTML][HTML] A survey of acoustic eavesdropping attacks: Principle, methods, and progress

Y Chen, W Li, XZ Cheng, P Hu - High-Confidence Computing, 2024 - Elsevier
In today's information age, eavesdropping has been one of the most serious privacy threats
in information security, such as exodus spyware (Rudie et al., 2021) and pegasus spyware …

Comparison of objective and subjective methods for evaluating speech quality and intelligibility recorded through bone conduction and in-ear microphones

J Richard, V Zimpfer, S Roth - Applied Acoustics, 2023 - Elsevier
Bone conduction and in-ear microphones pick up the Bone-conducted (BC) speech, which
has traveled through bones and soft tissues. This BC speech is less sensitive to surrounding …

Voicelistener: A training-free and universal eavesdropping attack on built-in speakers of mobile devices

L Wang, M Chen, L Lu, Z Ba, F Lin, K Ren - Proceedings of the ACM on …, 2023 - dl.acm.org
Recently, voice leakage gradually raises more significant concerns of users, due to its
underlying sensitive and private information when providing intelligent services. Existing …