Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation

R Wong, NC Camgoz, R Bowden - arXiv preprint arXiv:2405.04164, 2024 - arxiv.org
Automatic Sign Language Translation requires the integration of both computer vision and
natural language processing to effectively bridge the communication gap between sign and …

Artificial intelligence in sign language recognition: A comprehensive bibliometric and visual analysis

Y Zhang, Y Han, Z Zhu, X Jiang, Y Zhang - Computers and Electrical …, 2024 - Elsevier
Sign language recognition (SLR) plays a crucial role in bridging the communication gap
between individuals with hearing impairments and the auditory communities. This study …

[HTML][HTML] Quantifying inconsistencies in the Hamburg Sign Language Notation System

M Ferlin, S Majchrowska, M Plantykow… - Expert Systems with …, 2024 - Elsevier
The advent of machine learning (ML) has significantly advanced the recognition and
translation of sign languages, bridging communication gaps for hearing-impaired …

Unsupervised Sign Language Translation and Generation

Z Guo, Z He, W Jiao, X Wang, R Wang, K Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
Motivated by the success of unsupervised neural machine translation (UNMT), we introduce
an unsupervised sign language translation and generation network (USLNet), which learns …

Using an LLM to Turn Sign Spottings into Spoken Language Sentences

OM Sincan, NC Camgoz, R Bowden - arXiv preprint arXiv:2403.10434, 2024 - arxiv.org
Sign Language Translation (SLT) is a challenging task that aims to generate spoken
language sentences from sign language videos. In this paper, we introduce a hybrid SLT …

Reconsidering Sentence-Level Sign Language Translation

G Tanzer, M Shengelia, K Harrenstien… - arXiv preprint arXiv …, 2024 - arxiv.org
Historically, sign language machine translation has been posed as a sentence-level task:
datasets consisting of continuous narratives are chopped up and presented to the model as …

2M-BELEBELE: Highly Multilingual Speech and American Sign Language Comprehension Dataset

MR Costa-jussà, B Yu, P Andrews, B Alastruey… - arXiv preprint arXiv …, 2024 - arxiv.org
We introduce the first highly multilingual speech and American Sign Language (ASL)
comprehension dataset by extending BELEBELE. Our dataset covers 74 spoken languages …