Machine translation from signed to spoken languages: State of the art and challenges

M De Coster, D Shterionov, M Van Herreweghe… - Universal Access in the …, 2024 - Springer
Automatic translation from signed to spoken languages is an interdisciplinary research
domain on the intersection of computer vision, machine translation (MT), and linguistics …

Gloss attention for gloss-free sign language translation

A Yin, T Zhong, L Tang, W Jin… - Proceedings of the …, 2023 - openaccess.thecvf.com
Most sign language translation (SLT) methods to date require the use of gloss annotations to
provide additional supervision information, however, the acquisition of gloss is not easy. To …

Sign language translation from instructional videos

L Tarrés, GI Gállego, A Duarte… - Proceedings of the …, 2023 - openaccess.thecvf.com
The advances in automatic sign language translation (SLT) to spoken languages have been
mostly benchmarked with datasets of limited size and restricted domains. Our work …

Sign language translation: A survey of approaches and techniques

Z Liang, H Li, J Chai - Electronics, 2023 - mdpi.com
Sign language is the main communication way for deaf and hard-of-hearing (ie, DHH)
people, which is unfamiliar to most non-deaf and hard-of-hearing (non-DHH) people. To …

Auslan-daily: Australian sign language translation for daily communication and news

X Shen, S Yuan, H Sheng, H Du… - Advances in Neural …, 2024 - proceedings.neurips.cc
Sign language translation (SLT) aims to convert a continuous sign language video clip into a
spoken language. Considering different geographic regions generally have their own native …

Mlslt: Towards multilingual sign language translation

A Yin, Z Zhao, W Jin, M Zhang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Most of the research to date focuses on bilingual sign language translation (BSLT).
However, such models are inefficient in building multilingual sign language translation …

Open-domain sign language translation learned from online video

B Shi, D Brentari, G Shakhnarovich… - arXiv preprint arXiv …, 2022 - arxiv.org
Existing work on sign language translation-that is, translation from sign language videos into
sentences in a written language-has focused mainly on (1) data collected in a controlled …

[PDF][PDF] Contrastive Learning for Sign Language Recognition and Translation.

S Gan, Y Yin, Z Jiang, K Xia, L Xie, S Lu - IJCAI, 2023 - ijcai.org
There are two problems that widely exist in current end-to-end sign language processing
architecture. One is the CTC spike phenomenon which weakens the visual representational …

Sign2Pose: A Pose-Based Approach for Gloss Prediction Using a Transformer Model

J Eunice, Y Sei, DJ Hemanth - Sensors, 2023 - mdpi.com
Word-level sign language recognition (WSLR) is the backbone for continuous sign language
recognition (CSLR) that infers glosses from sign videos. Finding the relevant gloss from the …

Preprocessing for keypoint-based sign language translation without glosses

Y Kim, H Baek - Sensors, 2023 - mdpi.com
While machine translation for spoken language has advanced significantly, research on sign
language translation (SLT) for deaf individuals remains limited. Obtaining annotations, such …