Learning visual representation from modality-shared contrastive language-image pre-training
Large-scale multi-modal contrastive pre-training has demonstrated great utility to learn
transferable features for a range of downstream tasks by mapping multiple modalities into a …
transferable features for a range of downstream tasks by mapping multiple modalities into a …
Joint learning of localized representations from medical images and reports
Contrastive learning has proven effective for pre-training image models on unlabeled data
with promising results for tasks such as medical image classification. Using paired text (like …
with promising results for tasks such as medical image classification. Using paired text (like …
Position-guided text prompt for vision-language pre-training
Abstract Vision-Language Pre-Training (VLP) has shown promising capabilities to align
image and text pairs, facilitating a broad variety of cross-modal learning tasks. However, we …
image and text pairs, facilitating a broad variety of cross-modal learning tasks. However, we …
Borrowing knowledge from pre-trained language model: A new data-efficient visual learning paradigm
The development of vision models for real-world applications is hindered by the challenge of
annotated data scarcity, which has necessitated the adoption of data-efficient visual learning …
annotated data scarcity, which has necessitated the adoption of data-efficient visual learning …
Radiological reports improve pre-training for localized imaging tasks on chest x-rays
Self-supervised pre-training on unlabeled images has shown promising results in the
medical domain. Recently, methods using text-supervision from companion text like …
medical domain. Recently, methods using text-supervision from companion text like …
Answer-me: Multi-task open-vocabulary visual question answering
We present Answer-Me, a task-aware multi-task framework which unifies a variety of
question answering tasks, such as, visual question answering, visual entailment, visual …
question answering tasks, such as, visual question answering, visual entailment, visual …
Findit: Generalized localization with natural language queries
We propose FindIt, a simple and versatile framework that unifies a variety of visual
grounding and localization tasks including referring expression comprehension, text-based …
grounding and localization tasks including referring expression comprehension, text-based …
Free-atm: Exploring unsupervised learning on diffusion-generated images with free attention masks
Despite the rapid advancement of unsupervised learning in visual representation, it requires
training on large-scale datasets that demand costly data collection, and pose additional …
training on large-scale datasets that demand costly data collection, and pose additional …
Enhancing Visual Grounding in Vision-Language Pre-Training With Position-Guided Text Prompts
Vision-Language Pre-Training (VLP) has demonstrated remarkable potential in aligning
image and text pairs, paving the way for a wide range of cross-modal learning tasks …
image and text pairs, paving the way for a wide range of cross-modal learning tasks …
[PDF][PDF] Scaling up Instance Segmentation using Approximately Localized Phrases.
Training object detectors to segment large numbers of classes is challenging because they
require training masks for each class. A potential solution is to partially supervise detectors …
require training masks for each class. A potential solution is to partially supervise detectors …