Continuous sign language recognition with correlation network

L Hu, L Gao, Z Liu, W Feng - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
Human body trajectories are a salient cue to identify actions in video. Such body trajectories
are mainly conveyed by hands and face across consecutive frames in sign language …

Signbert+: Hand-model-aware self-supervised pre-training for sign language understanding

H Hu, W Zhao, W Zhou, H Li - IEEE Transactions on Pattern …, 2023 - ieeexplore.ieee.org
Hand gesture serves as a crucial role during the expression of sign language. Current deep
learning based methods for sign language understanding (SLU) are prone to over-fitting due …

Natural language-assisted sign language recognition

R Zuo, F Wei, B Mak - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Sign languages are visual languages which convey information by signers' handshape,
facial expression, body movement, and so forth. Due to the inherent restriction of …

Self-emphasizing network for continuous sign language recognition

L Hu, L Gao, Z Liu, W Feng - Proceedings of the AAAI Conference on …, 2023 - ojs.aaai.org
Hand and face play an important role in expressing sign language. Their features are
usually especially leveraged to improve system performance. However, to effectively extract …

Sign language translation: A survey of approaches and techniques

Z Liang, H Li, J Chai - Electronics, 2023 - mdpi.com
Sign language is the main communication way for deaf and hard-of-hearing (ie, DHH)
people, which is unfamiliar to most non-deaf and hard-of-hearing (non-DHH) people. To …

SignBERT: Pre-training of hand-model-aware representation for sign language recognition

H Hu, W Zhao, W Zhou, Y Wang… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Hand gesture serves as a critical role in sign language. Current deep-learning-based sign
language recognition (SLR) methods may suffer insufficient interpretability and overfitting …

BEST: BERT pre-training for sign language recognition with coupling tokenization

W Zhao, H Hu, W Zhou, J Shi, H Li - … of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
In this work, we are dedicated to leveraging the BERT pre-training success and modeling
the domain-specific statistics to fertilize the sign language recognition~(SLR) model …

ASL citizen: a community-sourced dataset for advancing isolated sign language recognition

A Desai, L Berger, F Minakov… - Advances in …, 2024 - proceedings.neurips.cc
Sign languages are used as a primary language by approximately 70 million D/deaf people
world-wide. However, most communication technologies operate in spoken and written …

Sign language recognition via skeleton-aware multi-model ensemble

S Jiang, B Sun, L Wang, Y Bai, K Li, Y Fu - arXiv preprint arXiv:2110.06161, 2021 - arxiv.org
Sign language is commonly used by deaf or mute people to communicate but requires
extensive effort to master. It is usually performed with the fast yet delicate movement of hand …

Full transformer network with masking future for word-level sign language recognition

Y Du, P Xie, M Wang, X Hu, Z Zhao, J Liu - Neurocomputing, 2022 - Elsevier
Word-level sign language recognition (SLR) is a significant task which transcribes a sign
language video into a word. Currently, deep-learning-based frameworks mostly combine …