[HTML][HTML] Machine translation from signed to spoken languages: State of the art and challenges
Automatic translation from signed to spoken languages is an interdisciplinary research
domain on the intersection of computer vision, machine translation (MT), and linguistics …
domain on the intersection of computer vision, machine translation (MT), and linguistics …
[HTML][HTML] Audio-visual speech and gesture recognition by sensors of mobile devices
Audio-visual speech recognition (AVSR) is one of the most promising solutions for reliable
speech recognition, particularly when audio is corrupted by noise. Additional visual …
speech recognition, particularly when audio is corrupted by noise. Additional visual …
Sign language translation from instructional videos
The advances in automatic sign language translation (SLT) to spoken languages have been
mostly benchmarked with datasets of limited size and restricted domains. Our work …
mostly benchmarked with datasets of limited size and restricted domains. Our work …
Findings of the first wmt shared task on sign language translation (wmt-slt22)
This paper presents the results of the First WMT Shared Task on Sign Language Translation
(WMT-SLT22). This shared task is concerned with automatic translation between signed and …
(WMT-SLT22). This shared task is concerned with automatic translation between signed and …
Is context all you need? scaling neural sign language translation to large domains of discourse
Abstract Sign Language Translation (SLT) is a challenging task that aims to generate
spoken language sentences from sign language videos, both of which have different …
spoken language sentences from sign language videos, both of which have different …
TTIC's Submission to WMT-SLT 23
In this paper, we describe TTIC's submission to WMT 2023 Sign Language Translation task
on the Swiss-German Sign Language (DSGS) to German track. Our approach explores the …
on the Swiss-German Sign Language (DSGS) to German track. Our approach explores the …
Unsupervised Sign Language Translation and Generation
Motivated by the success of unsupervised neural machine translation (UNMT), we introduce
an unsupervised sign language translation and generation network (USLNet), which learns …
an unsupervised sign language translation and generation network (USLNet), which learns …