Jwsign: A highly multilingual corpus of bible translations for more diversity in sign language processing

S Gueuwou, S Siake, C Leong, M Müller - arXiv preprint arXiv:2311.10174, 2023 - arxiv.org
Advancements in sign language processing have been hindered by a lack of sufficient data,
impeding progress in recognition, translation, and production tasks. The absence of …

Afrisign: Machine translation for african sign languages

S Gueuwou, K Takyi, M Müller, MS Nyarko, R Adade… - 2023 - zora.uzh.ch
Sign language translation is an active area of research with the main goal of bridging the
communication gap between deaf and hearing individuals. In Natural Language Processing …

iSign: A Benchmark for Indian Sign Language Processing

A Joshi, R Mohanty, M Kanakanti, A Mangla… - arXiv preprint arXiv …, 2024 - arxiv.org
Indian Sign Language has limited resources for developing machine learning and data-
driven approaches for automated language processing. Though text/audio-based language …

Leveraging large language models with vocabulary sharing for sign language translation

H Lee, JH Kim, EJ Hwang, J Kim… - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
Sign language translation (SLT) is a task that provides translation between spoken and sign
languages used in the same country, which tend to show high lexical similarity but low …

Universal Gloss-level Representation for Gloss-free Sign Language Translation and Production

EJ Hwang, S Cho, H Lee, Y Yoon, JC Park - arXiv preprint arXiv …, 2024 - arxiv.org
Sign language, essential for the deaf and hard-of-hearing, presents unique challenges in
translation and production due to its multimodal nature and the inherent ambiguity in …

A roadmap for technological innovation in multimodal communication research

A Gregori, F Amici, I Brilmayer, A Ćwiek… - … Conference on Human …, 2023 - Springer
Multimodal communication research focuses on how different means of signalling
coordinate to communicate effectively. This line of research is traditionally influenced by …

sign. mt: Real-Time Multilingual Sign Language Translation Application

A Moryossef - arXiv preprint arXiv:2310.05064, 2023 - arxiv.org
This demo paper presents sign. mt, an open-source application pioneering real-time
multilingual bi-directional translation between spoken and signed languages. Harnessing …

A Data-Driven Representation for Sign Language Production

H Walsh, A Ravanshad, M Rahmani… - arXiv preprint arXiv …, 2024 - arxiv.org
Phonetic representations are used when recording spoken languages, but no equivalent
exists for recording signed languages. As a result, linguists have proposed several …

Real-Time Multilingual Sign Language Processing

A Moryossef - arXiv preprint arXiv:2412.01991, 2024 - arxiv.org
Sign Language Processing (SLP) is an interdisciplinary field comprised of Natural
Language Processing (NLP) and Computer Vision. It is focused on the computational …

SignBank+: Multilingual Sign Language Translation Dataset

A Moryossef, Z Jiang - arXiv preprint arXiv:2309.11566, 2023 - arxiv.org
This work advances the field of sign language machine translation by focusing on dataset
quality and simplification of the translation system. We introduce SignBank+, a clean version …