Towards Online Continuous Sign Language Recognition and Translation

R Zuo, F Wei, B Mak - Proceedings of the 2024 Conference on …, 2024 - aclanthology.org
Research on continuous sign language recognition (CSLR) is essential to bridge the
communication gap between deaf and hearing individuals. Numerous previous studies have …

Designing and Evaluating an Advanced Dance Video Comprehension Tool with In-situ Move Identification Capabilities

S Hassan, C de Lacerda Pataca, L Nourian… - Proceedings of the CHI …, 2024 - dl.acm.org
Analyzing dance moves and routines is a foundational step in learning dance. Videos are
often utilized at this step, and advancements in machine learning, particularly in human …

sign. mt: Real-Time Multilingual Sign Language Translation Application

A Moryossef - arXiv preprint arXiv:2310.05064, 2023 - arxiv.org
This demo paper presents sign. mt, an open-source application pioneering real-time
multilingual bi-directional translation between spoken and signed languages. Harnessing …

Sign Stitching: A Novel Approach to Sign Language Production

H Walsh, B Saunders, R Bowden - arXiv preprint arXiv:2405.07663, 2024 - arxiv.org
Sign Language Production (SLP) is a challenging task, given the limited resources available
and the inherent diversity within sign data. As a result, previous works have suffered from the …

Real-Time Multilingual Sign Language Processing

A Moryossef - arXiv preprint arXiv:2412.01991, 2024 - arxiv.org
Sign Language Processing (SLP) is an interdisciplinary field comprised of Natural
Language Processing (NLP) and Computer Vision. It is focused on the computational …

Pose-Based Sign Language Appearance Transfer

A Moryossef, G Sant, Z Jiang - arXiv preprint arXiv:2410.13675, 2024 - arxiv.org
We introduce a method for transferring the signer's appearance in sign language skeletal
poses while preserving the sign content. Using estimated poses, we transfer the appearance …

An Open-Source American Sign Language Fingerspell Recognition and Semantic Pose Retrieval Interface

KJ Thomas - arXiv preprint arXiv:2408.09311, 2024 - arxiv.org
This paper introduces an open-source interface for American Sign Language fingerspell
recognition and semantic pose retrieval, aimed to serve as a stepping stone towards more …

[PDF][PDF] Evaluating the Alignment of Utterances in the Swedish Sign Language Corpus

C Börstell - Proceedings of the LREC-COLING 2024 11th …, 2024 - aclanthology.org
Abstract The Swedish Sign Language (STS) Corpus mainly contains segmentations on the
lexical level (ie signs), which makes it difficult to extract information at clause-or utterance …

SwissSLi: The Multi-parallel Sign Language Corpus for Switzerland

Z Jiang, A Göhring, A Moryossef… - Proceedings of the …, 2024 - aclanthology.org
In this work, we introduce SwissSLi, the first sign language corpus that contains parallel data
of all three Swiss sign languages, namely Swiss German Sign Language (DSGS), French …

The Key Points: Using Feature Importance to Identify Shortcomings in Sign Language Recognition Models

RM Holmes, E Rushe, A Ventresque - Proceedings of the 2024 …, 2024 - aclanthology.org
Pose estimation keypoints are widely used in sign language recognition (SLR) as a means
of generalising to unseen signers. Despite the advantages of keypoints, SLR models …