Abstract Sign Languages (SLs) are employed by deaf and hard-of-hearing (DHH) people to
communicate on a daily basis. However, the communication with hearing people still faces …

AI technologies can play an important role in breaking down the communication barriers of
deaf or hearing-impaired people with other communities, contributing significantly to their …

Video recordings of speech contain correlated audio and visual information, providing a
strong signal for speech representation learning from the speaker's lip movements and the …

Sign languages are visual languages using manual articulations and non-manual elements
to convey information. For sign language recognition and translation, the majority of existing …

This paper proposes a simple transfer learning baseline for sign language translation.
Existing sign language datasets (eg PHOENIX-2014T, CSL-Daily) contain only about 10K …

Despite existing pioneering works on sign language translation (SLT), there is a non-trivial
obstacle, ie, the limited quantity of parallel sign-text data. To tackle this parallel data …

One of the factors that have hindered progress in the areas of sign language recognition,
translation, and production is the absence of large annotated datasets. Towards this end, we …

Hand gesture serves as a crucial role during the expression of sign language. Current deep
learning based methods for sign language understanding (SLU) are prone to over-fitting due …

The exploration of multimodal language models integrates multiple data types, such as
images, text, language, audio, and other heterogeneity. While the latest large language …

This work focuses on sign language retrieval--a recently proposed task for sign language
understanding. Sign language retrieval consists of two sub-tasks: text-to-sign-video (T2V) …