Silent speech interfaces for speech restoration: A review

JA Gonzalez-Lopez, A Gomez-Alanis… - IEEE …, 2020 - ieeexplore.ieee.org
This review summarises the status of silent speech interface (SSI) research. SSIs rely on non-
acoustic biosignals generated by the human body during speech production to enable …

Lipreading with long short-term memory

M Wand, J Koutník… - 2016 IEEE International …, 2016 - ieeexplore.ieee.org
Lipreading, ie speech recognition from visual-only recordings of a speaker's face, can be
achieved with a processing pipeline based solely on neural networks, yielding significantly …

Silent speech interfaces

B Denby, T Schultz, K Honda, T Hueber, JM Gilbert… - Speech …, 2010 - Elsevier
The possibility of speech processing in the absence of an intelligible acoustic signal has
given rise to the idea of a 'silent speech'interface, to be used as an aid for the speech …

Biosignal-based spoken communication: A survey

T Schultz, M Wand, T Hueber… - … on Audio, Speech …, 2017 - ieeexplore.ieee.org
Speech is a complex process involving a wide range of biosignals, including but not limited
to acoustics. These biosignals-stemming from the articulators, the articulator muscle …

u-hubert: Unified mixed-modal speech pretraining and zero-shot transfer to unlabeled modality

WN Hsu, B Shi - Advances in Neural Information Processing …, 2022 - proceedings.neurips.cc
While audio-visual speech models can yield superior performance and robustness
compared to audio-only models, their development and adoption are hindered by the lack of …

3D printed stretchable triboelectric nanogenerator fibers and devices

Y Tong, Z Feng, J Kim, JL Robertson, X Jia… - Nano Energy, 2020 - Elsevier
Triboelectric generators and sensors have a great potential as self-powered wearable
devices for energy harvesting, biomedical monitoring, and recording human activity. Here …

SottoVoce: An ultrasound imaging-based silent speech interaction using deep neural networks

N Kimura, M Kono, J Rekimoto - … of the 2019 CHI Conference on Human …, 2019 - dl.acm.org
The availability of digital devices operated by voice is expanding rapidly. However, the
applications of voice interfaces are still restricted. For example, speaking in public places …

Muteit: Jaw motion based unvoiced command recognition using earable

T Srivastava, P Khanna, S Pan, P Nguyen… - Proceedings of the ACM …, 2022 - dl.acm.org
In this paper, we present MuteIt, an ear-worn system for recognizing unvoiced human
commands. MuteIt presents an intuitive alternative to voice-based interactions that can be …

Lip-interact: Improving mobile device interaction with silent speech commands

K Sun, C Yu, W Shi, L Liu, Y Shi - Proceedings of the 31st Annual ACM …, 2018 - dl.acm.org
We present Lip-Interact, an interaction technique that allows users to issue commands on
their smartphone through silent speech. Lip-Interact repurposes the front camera to capture …

Statistical voice conversion techniques for body-conducted unvoiced speech enhancement

T Toda, M Nakagiri, K Shikano - IEEE Transactions on Audio …, 2012 - ieeexplore.ieee.org
In this paper, we present statistical approaches to enhance body-conducted unvoiced
speech for silent speech communication. A body-conductive microphone called nonaudible …