Small data challenges in big data era: A survey of recent progress on unsupervised and semi-supervised methods

GJ Qi, J Luo - IEEE Transactions on Pattern Analysis and …, 2020 - ieeexplore.ieee.org
Representation learning with small labeled data have emerged in many problems, since the
success of deep neural networks often relies on the availability of a huge amount of labeled …

Wave-vit: Unifying wavelet and transformers for visual representation learning

T Yao, Y Pan, Y Li, CW Ngo, T Mei - European Conference on Computer …, 2022 - Springer
Abstract Multi-scale Vision Transformer (ViT) has emerged as a powerful backbone for
computer vision tasks, while the self-attention computation in Transformer scales …

Unsupervised embedding learning via invariant and spreading instance feature

M Ye, X Zhang, PC Yuen… - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
This paper studies the unsupervised embedding learning problem, which requires an
effective similarity measurement between samples in low-dimensional embedding space …

Invariant information clustering for unsupervised image classification and segmentation

X Ji, JF Henriques, A Vedaldi - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
We present a novel clustering objective that learns a neural network classifier from scratch,
given only unlabelled data samples. The model discovers clusters that accurately match …

Approximating cnns with bag-of-local-features models works surprisingly well on imagenet

W Brendel, M Bethge - arXiv preprint arXiv:1904.00760, 2019 - arxiv.org
Deep Neural Networks (DNNs) excel on many complex perceptual tasks but it has proven
notoriously difficult to understand how they reach their decisions. We here introduce a high …

Unsupervised representation learning by predicting image rotations

S Gidaris, P Singh, N Komodakis - arXiv preprint arXiv:1803.07728, 2018 - arxiv.org
Over the last years, deep convolutional neural networks (ConvNets) have transformed the
field of computer vision thanks to their unparalleled capacity to learn high level semantic …

Learning operators with coupled attention

G Kissas, JH Seidman, LF Guilhoto… - Journal of Machine …, 2022 - jmlr.org
Supervised operator learning is an emerging machine learning paradigm with applications
to modeling the evolution of spatio-temporal dynamical systems and approximating general …

Photorealistic style transfer via wavelet transforms

J Yoo, Y Uh, S Chun, B Kang… - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
Recent style transfer models have provided promising artistic results. However, given a
photograph as a reference style, existing methods are limited by spatial distortions or …

Image classification with small datasets: Overview and benchmark

L Brigato, B Barz, L Iocchi, J Denzler - IEEE Access, 2022 - ieeexplore.ieee.org
Image classification with small datasets has been an active research area in the recent past.
However, as research in this scope is still in its infancy, two key ingredients are missing for …

PHA: Patch-wise high-frequency augmentation for transformer-based person re-identification

G Zhang, Y Zhang, T Zhang, B Li… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Although recent studies empirically show that injecting Convolutional Neural Networks
(CNNs) into Vision Transformers (ViTs) can improve the performance of person re …