Reviewing 25 years of continuous sign language recognition research: Advances, challenges, and prospects

S Alyami, H Luqman, M Hammoudeh - Information Processing & …, 2024 - Elsevier
Sign language is a form of visual communication employing hand gestures, body
movements, and facial expressions. The growing prevalence of hearing impairment has …

Generative bias for robust visual question answering

JW Cho, DJ Kim, H Ryu… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Abstract The task of Visual Question Answering (VQA) is known to be plagued by the issue
of VQA models exploiting biases within the dataset to make its final prediction. Various …

Semi-supervised image captioning by adversarially propagating labeled data

DJ Kim, TH Oh, J Choi, IS Kweon - IEEE Access, 2024 - ieeexplore.ieee.org
We present a novel data-efficient semi-supervised framework to improve the generalization
of image captioning models. Constructing a large-scale labeled image captioning dataset is …

Slowfast Network for Continuous Sign Language Recognition

J Ahn, Y Jang, JS Chung - ICASSP 2024-2024 IEEE …, 2024 - ieeexplore.ieee.org
The objective of this work is the effective extraction of spatial and dynamic features for
Continuous Sign Language Recognition (CSLR). To accomplish this, we utilise a two …

Let Me Finish My Sentence: Video Temporal Grounding with Holistic Text Understanding

J Woo, H Ryu, Y Jang, JW Cho, JS Chung - Proceedings of the 32nd …, 2024 - dl.acm.org
Video Temporal Grounding (VTG) aims to identify visual frames in a video clip that match
text queries. Recent studies in VTG employ cross-attention to correlate visual frames and …

Swin-MSTP: Swin transformer with multi-scale temporal perception for continuous sign language recognition

S Alyami, H Luqman - Neurocomputing, 2024 - Elsevier
Continuous sign language recognition (CSLR) aims to recognize and interpret sequences of
sign language gestures in videos. Currently, most CSLR frameworks combine spatial feature …

Preserving Multi-Modal Capabilities of Pre-trained VLMs for Improving Vision-Linguistic Compositionality

Y Oh, JW Cho, DJ Kim, IS Kweon, J Kim - arXiv preprint arXiv:2410.05210, 2024 - arxiv.org
In this paper, we propose a new method to enhance compositional understanding in pre-
trained vision and language models (VLMs) without sacrificing performance in zero-shot …

Sign language translation with hierarchical memorized context in question answering scenarios

L Gao, W Feng, P Shi, R Han, D Lin, L Wan - Neural Computing and …, 2024 - Springer
Vision-based sign language translation (SLT) targets to translate sign language videos into
understandable natural language sentences. Current SLT methods ignore the utilization of …

Modeling semantic correlation and hierarchy for real-world wildlife recognition

DJ Kim, Z Miao, Y Guo, XY Stella - IEEE Signal Processing …, 2023 - ieeexplore.ieee.org
We explore the challenges of human-in-the-loop frameworks to label wildlife recognition
datasets with a neural network. In wildlife imagery, the main challenges for a model to assist …

A Comparative Study of Continuous Sign Language Recognition Techniques

S Alyami, H Luqman - arXiv preprint arXiv:2406.12369, 2024 - arxiv.org
Continuous Sign Language Recognition (CSLR) focuses on the interpretation of a sequence
of sign language gestures performed continually without pauses. In this study, we conduct …