Logme: Practical assessment of pre-trained models for transfer learning
This paper studies task adaptive pre-trained model selection, an underexplored problem of
assessing pre-trained models for the target task and select best ones from the model …
assessing pre-trained models for the target task and select best ones from the model …
A survey on negative transfer
Transfer learning (TL) utilizes data or knowledge from one or more source domains to
facilitate learning in a target domain. It is particularly useful when the target domain has very …
facilitate learning in a target domain. It is particularly useful when the target domain has very …
How far pre-trained models are from neural collapse on the target dataset informs their transferability
This paper focuses on model transferability estimation, ie, assessing the performance of pre-
trained models on a downstream task without performing fine-tuning. Motivated by the …
trained models on a downstream task without performing fine-tuning. Motivated by the …
img2pose: Face alignment and detection via 6dof, face pose estimation
We propose real-time, six degrees of freedom (6DoF), 3D face pose estimation without face
detection or landmark localization. We observe that estimating the 6DoF rigid transformation …
detection or landmark localization. We observe that estimating the 6DoF rigid transformation …
Breaking the data barrier: a review of deep learning techniques for democratizing AI with small datasets
IH Rather, S Kumar, AH Gandomi - Artificial Intelligence Review, 2024 - Springer
Justifiably, while big data is the primary interest of research and public discourse, it is
essential to acknowledge that small data remains prevalent. The same technological and …
essential to acknowledge that small data remains prevalent. The same technological and …
Leep: A new measure to evaluate transferability of learned representations
We introduce a new measure to evaluate the transferability of representations learned by
classifiers. Our measure, the Log Expected Empirical Prediction (LEEP), is simple and easy …
classifiers. Our measure, the Log Expected Empirical Prediction (LEEP), is simple and easy …
What makes instance discrimination good for transfer learning?
Contrastive visual pretraining based on the instance discrimination pretext task has made
significant progress. Notably, recent work on unsupervised pretraining has shown to surpass …
significant progress. Notably, recent work on unsupervised pretraining has shown to surpass …
Geometric dataset distances via optimal transport
D Alvarez-Melis, N Fusi - Advances in Neural Information …, 2020 - proceedings.neurips.cc
The notion of task similarity is at the core of various machine learning paradigms, such as
domain adaptation and meta-learning. Current methods to quantify it are often heuristic …
domain adaptation and meta-learning. Current methods to quantify it are often heuristic …
Transferability estimation using bhattacharyya class separability
Transfer learning has become a popular method for leveraging pre-trained models in
computer vision. However, without performing computationally expensive fine-tuning, it is …
computer vision. However, without performing computationally expensive fine-tuning, it is …