Visuals to text: A comprehensive review on automatic image captioning
Y Ming, N Hu, C Fan, F Feng… - IEEE/CAA Journal of …, 2022 - researchportal.port.ac.uk
Image captioning refers to automatic generation of descriptive texts according to the visual
content of images. It is a technique integrating multiple disciplines including the computer …
content of images. It is a technique integrating multiple disciplines including the computer …
Making the most of text semantics to improve biomedical vision–language processing
Multi-modal data abounds in biomedicine, such as radiology images and reports.
Interpreting this data at scale is essential for improving clinical care and accelerating clinical …
Interpreting this data at scale is essential for improving clinical care and accelerating clinical …
Open-vocabulary object detection using captions
Despite the remarkable accuracy of deep neural networks in object detection, they are costly
to train and scale due to supervision requirements. Particularly, learning more object …
to train and scale due to supervision requirements. Particularly, learning more object …
Scanrefer: 3d object localization in rgb-d scans using natural language
We introduce the task of 3D object localization in RGB-D scans using natural language
descriptions. As input, we assume a point cloud of a scanned 3D scene along with a free …
descriptions. As input, we assume a point cloud of a scanned 3D scene along with a free …
Counterfactual contrastive learning for weakly-supervised vision-language grounding
Weakly-supervised vision-language grounding aims to localize a target moment in a video
or a specific region in an image according to the given sentence query, where only video …
or a specific region in an image according to the given sentence query, where only video …
More grounded image captioning by distilling image-text matching model
Visual attention not only improves the performance of image captioners, but also serves as a
visual interpretation to qualitatively measure the caption rationality and model transparency …
visual interpretation to qualitatively measure the caption rationality and model transparency …
Referring image segmentation using text supervision
Abstract Existing Referring Image Segmentation (RIS) methods typically require expensive
pixel-level or box-level annotations for supervision. In this paper, we observe that the …
pixel-level or box-level annotations for supervision. In this paper, we observe that the …
What does BERT with vision look at?
Pre-trained visually grounded language models such as ViLBERT, LXMERT, and UNITER
have achieved significant performance improvement on vision-and-language tasks but what …
have achieved significant performance improvement on vision-and-language tasks but what …
Pseudo-q: Generating pseudo language queries for visual grounding
Visual grounding, ie, localizing objects in images according to natural language queries, is
an important topic in visual language understanding. The most effective approaches for this …
an important topic in visual language understanding. The most effective approaches for this …
Contrastive learning for weakly supervised phrase grounding
Phrase grounding, the problem of associating image regions to caption words, is a crucial
component of vision-language tasks. We show that phrase grounding can be learned by …
component of vision-language tasks. We show that phrase grounding can be learned by …