Contrastive deep supervision
… Recently, deep supervision has been proposed to add auxiliary classifiers … deep neural
networks. By optimizing these auxiliary classifiers with the supervised task loss, the supervision …
networks. By optimizing these auxiliary classifiers with the supervised task loss, the supervision …
Supervised contrastive learning
… The cross-entropy loss is the most widely used loss function for supervised learning of deep
classification models. A number of works have explored shortcomings of this loss, such as …
classification models. A number of works have explored shortcomings of this loss, such as …
Self-supervised learning: Generative or contrastive
… Abstract—Deep supervised learning has achieved great success in the last decade. However,
its defects of heavy dependence on manual labels and vulnerability to attacks have driven …
its defects of heavy dependence on manual labels and vulnerability to attacks have driven …
On the effects of self-supervision and contrastive alignment in deep multi-view clustering
… approaches to deep multi-… supervision-based methods for deep MVC, potentially slowing
the progress of the field. To address this, we present DeepMVC, a unified framework for deep …
the progress of the field. To address this, we present DeepMVC, a unified framework for deep …
Supervision exists everywhere: A data efficient contrastive language-image pre-training paradigm
… the widespread supervision among the … -text contrastive supervision, we fully exploit data
potential through the use of (1) self-supervision within each modality; (2) multi-view supervision …
potential through the use of (1) self-supervision within each modality; (2) multi-view supervision …
A survey on contrastive self-supervised learning
… Similar to other deep learning methods, contrastive learning employs a variety of optimization
algorithms for training. The training process involves learning the parameters of encoder …
algorithms for training. The training process involves learning the parameters of encoder …
Provable guarantees for self-supervised deep learning with spectral contrastive loss
… -art by relying on the contrastive learning paradigm, which learns … Our work analyzes
contrastive learning without assuming … provable analysis for contrastive learning where …
contrastive learning without assuming … provable analysis for contrastive learning where …
Adversarial self-supervised contrastive learning
… learning is a research direction that delved into the vulnerability of deep networks in the
intrinsic representation space, which we believe is the root cause of fragility of existing …
intrinsic representation space, which we believe is the root cause of fragility of existing …
Contrastive self-supervised learning: review, progress, challenges and future research directions
… In the last decade, deep supervised learning has had tremendous success. However, its …
Incorporating contrastive learning (CL) for self-supervised learning (SSL) has turned out as …
Incorporating contrastive learning (CL) for self-supervised learning (SSL) has turned out as …
Self-supervised learning on graphs: Contrastive, generative, or predictive
Deep learning on graphs has recently achieved remarkable success on a variety of tasks,
while such success relies heavily on the massive and carefully labeled data. However, precise …
while such success relies heavily on the massive and carefully labeled data. However, precise …