Gloss semantic-enhanced network with online back-translation for sign language production

S Tang, R Hong, D Guo, M Wang - Proceedings of the 30th ACM …, 2022 - dl.acm.org
Sign Language Production (SLP) aims to generate the visual appearance of sign language
according to the spoken language, in which a key procedure is to translate sign Gloss to …

Gloss-driven Conditional Diffusion Models for Sign Language Production

S Tang, F Xue, J Wu, S Wang, R Hong - ACM Transactions on …, 2024 - dl.acm.org
Sign Language Production (SLP) aims to convert text or audio sentences into sign language
videos corresponding to their semantics, which is challenging due to the diversity and …

Application of virtual human sign language translation based on speech recognition

X Li, S Yang, H Guo - Speech Communication, 2023 - Elsevier
For the application problem of speech recognition to sign language translation, we
conducted a study in two parts: improving speech recognition's effectiveness and promoting …

Discrete to Continuous: Generating Smooth Transition Poses from Sign Language Observation

S Tang, J He, L Cheng, J Wu, D Guo… - arXiv preprint arXiv …, 2024 - arxiv.org
Generating continuous sign language videos from discrete segments is challenging due to
the need for smooth transitions that preserve natural flow and meaning. Traditional …

Generative Interpolation of Sign Language Poses using RVQ-VAE

FOT Cruz, G Bejarano - Latinx in AI@ NeurIPS 2024 - openreview.net
In Sign Language Production (SLP) tasks, a common approach is to have individual sign
language words and then concatenate their motion representation to form complete …