Pre-trained language models for text generation: A survey
Text Generation aims to produce plausible and readable text in human language from input
data. The resurgence of deep learning has greatly advanced this field, in particular, with the …
data. The resurgence of deep learning has greatly advanced this field, in particular, with the …
Neural collapse: A review on modelling principles and generalization
V Kothapalli - arXiv preprint arXiv:2206.04041, 2022 - arxiv.org
Deep classifier neural networks enter the terminal phase of training (TPT) when training
error reaches zero and tend to exhibit intriguing Neural Collapse (NC) properties. Neural …
error reaches zero and tend to exhibit intriguing Neural Collapse (NC) properties. Neural …
Fsce: Few-shot object detection via contrastive proposal encoding
Emerging interests have been brought to recognize previously unseen objects given very
few training examples, known as few-shot object detection (FSOD). Recent researches …
few training examples, known as few-shot object detection (FSOD). Recent researches …
Supervised contrastive learning
Contrastive learning applied to self-supervised representation learning has seen a
resurgence in recent years, leading to state of the art performance in the unsupervised …
resurgence in recent years, leading to state of the art performance in the unsupervised …
Supervised contrastive learning for pre-trained language model fine-tuning
State-of-the-art natural language understanding classification models follow two-stages: pre-
training a large language model on an auxiliary task, and then fine-tuning the model on a …
training a large language model on an auxiliary task, and then fine-tuning the model on a …
Fantastic generalization measures and where to find them
Generalization of deep networks has been of great interest in recent years, resulting in a
number of theoretically and empirically motivated complexity measures. However, most …
number of theoretically and empirically motivated complexity measures. However, most …
Less: Label-efficient semantic segmentation for lidar point clouds
Semantic segmentation of LiDAR point clouds is an important task in autonomous driving.
However, training deep models via conventional supervised methods requires large …
However, training deep models via conventional supervised methods requires large …
Learning with fantasy: Semantic-aware virtual contrastive constraint for few-shot class-incremental learning
Few-shot class-incremental learning (FSCIL) aims at learning to classify new classes
continually from limited samples without forgetting the old classes. The mainstream …
continually from limited samples without forgetting the old classes. The mainstream …
Contrastive learning for label efficient semantic segmentation
Collecting labeled data for the task of semantic segmentation is expensive and time-
consuming, as it requires dense pixel-level annotations. While recent Convolutional Neural …
consuming, as it requires dense pixel-level annotations. While recent Convolutional Neural …
[HTML][HTML] Applying supervised contrastive learning for the detection of diabetic retinopathy and its severity levels from fundus images
Diabetic Retinopathy (DR) is a major complication in human eyes among the diabetic
patients. Early detection of the DR can save many patients from permanent blindness …
patients. Early detection of the DR can save many patients from permanent blindness …