Deep model reassembly

X Yang, D Zhou, S Liu, J Ye… - Advances in neural …, 2022 - proceedings.neurips.cc
In this paper, we explore a novel knowledge-transfer task, termed as Deep Model
Reassembly (DeRy), for general-purpose model reuse. Given a collection of heterogeneous …

Logme: Practical assessment of pre-trained models for transfer learning

K You, Y Liu, J Wang, M Long - International Conference on …, 2021 - proceedings.mlr.press
This paper studies task adaptive pre-trained model selection, an underexplored problem of
assessing pre-trained models for the target task and select best ones from the model …

A survey on negative transfer

W Zhang, L Deng, L Zhang, D Wu - IEEE/CAA Journal of …, 2022 - ieeexplore.ieee.org
Transfer learning (TL) utilizes data or knowledge from one or more source domains to
facilitate learning in a target domain. It is particularly useful when the target domain has very …

How far pre-trained models are from neural collapse on the target dataset informs their transferability

Z Wang, Y Luo, L Zheng, Z Huang… - Proceedings of the …, 2023 - openaccess.thecvf.com
This paper focuses on model transferability estimation, ie, assessing the performance of pre-
trained models on a downstream task without performing fine-tuning. Motivated by the …

img2pose: Face alignment and detection via 6dof, face pose estimation

V Albiero, X Chen, X Yin, G Pang… - Proceedings of the …, 2021 - openaccess.thecvf.com
We propose real-time, six degrees of freedom (6DoF), 3D face pose estimation without face
detection or landmark localization. We observe that estimating the 6DoF rigid transformation …

Breaking the data barrier: a review of deep learning techniques for democratizing AI with small datasets

IH Rather, S Kumar, AH Gandomi - Artificial Intelligence Review, 2024 - Springer
Justifiably, while big data is the primary interest of research and public discourse, it is
essential to acknowledge that small data remains prevalent. The same technological and …

Leep: A new measure to evaluate transferability of learned representations

C Nguyen, T Hassner, M Seeger… - International …, 2020 - proceedings.mlr.press
We introduce a new measure to evaluate the transferability of representations learned by
classifiers. Our measure, the Log Expected Empirical Prediction (LEEP), is simple and easy …

What makes instance discrimination good for transfer learning?

N Zhao, Z Wu, RWH Lau, S Lin - arXiv preprint arXiv:2006.06606, 2020 - arxiv.org
Contrastive visual pretraining based on the instance discrimination pretext task has made
significant progress. Notably, recent work on unsupervised pretraining has shown to surpass …

Geometric dataset distances via optimal transport

D Alvarez-Melis, N Fusi - Advances in Neural Information …, 2020 - proceedings.neurips.cc
The notion of task similarity is at the core of various machine learning paradigms, such as
domain adaptation and meta-learning. Current methods to quantify it are often heuristic …

Transferability estimation using bhattacharyya class separability

M Pándy, A Agostinelli, J Uijlings… - Proceedings of the …, 2022 - openaccess.thecvf.com
Transfer learning has become a popular method for leveraging pre-trained models in
computer vision. However, without performing computationally expensive fine-tuning, it is …