Deep learning for time series forecasting: a survey

JF Torres, D Hadjout, A Sebaa, F Martínez-Álvarez… - Big Data, 2021 - liebertpub.com
Time series forecasting has become a very intensive field of research, which is even
increasing in recent years. Deep neural networks have proved to be powerful and are …

Hyper-parameter optimization: A review of algorithms and applications

T Yu, H Zhu - arXiv preprint arXiv:2003.05689, 2020 - arxiv.org
Since deep neural networks were developed, they have made huge contributions to
everyday lives. Machine learning provides more rational advice than humans are capable of …

Adaptformer: Adapting vision transformers for scalable visual recognition

S Chen, C Ge, Z Tong, J Wang… - Advances in …, 2022 - proceedings.neurips.cc
Abstract Pretraining Vision Transformers (ViTs) has achieved great success in visual
recognition. A following scenario is to adapt a ViT to various image and video recognition …

[HTML][HTML] 3DFlex: determining structure and motion of flexible proteins from cryo-EM

A Punjani, DJ Fleet - Nature Methods, 2023 - nature.com
Modeling flexible macromolecules is one of the foremost challenges in single-particle
cryogenic-electron microscopy (cryo-EM), with the potential to illuminate fundamental …

Why can gpt learn in-context? language models implicitly perform gradient descent as meta-optimizers

D Dai, Y Sun, L Dong, Y Hao, S Ma, Z Sui… - arXiv preprint arXiv …, 2022 - arxiv.org
Large pretrained language models have shown surprising in-context learning (ICL) ability.
With a few demonstration input-label pairs, they can predict the label for an unseen input …

Flexmatch: Boosting semi-supervised learning with curriculum pseudo labeling

B Zhang, Y Wang, W Hou, H Wu… - Advances in …, 2021 - proceedings.neurips.cc
The recently proposed FixMatch achieved state-of-the-art results on most semi-supervised
learning (SSL) benchmarks. However, like other modern SSL algorithms, FixMatch uses a …

Resnet strikes back: An improved training procedure in timm

R Wightman, H Touvron, H Jégou - arXiv preprint arXiv:2110.00476, 2021 - arxiv.org
The influential Residual Networks designed by He et al. remain the gold-standard
architecture in numerous scientific publications. They typically serve as the default …

Simmatch: Semi-supervised learning with similarity matching

M Zheng, S You, L Huang, F Wang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Learning with few labeled data has been a longstanding problem in the computer vision and
machine learning research community. In this paper, we introduced a new semi-supervised …

Federated learning on non-IID data: A survey

H Zhu, J Xu, S Liu, Y Jin - Neurocomputing, 2021 - Elsevier
Federated learning is an emerging distributed machine learning framework for privacy
preservation. However, models trained in federated learning usually have worse …

Transmorph: Transformer for unsupervised medical image registration

J Chen, EC Frey, Y He, WP Segars, Y Li, Y Du - Medical image analysis, 2022 - Elsevier
In the last decade, convolutional neural networks (ConvNets) have been a major focus of
research in medical image analysis. However, the performances of ConvNets may be limited …