Self-supervised learning for time series analysis: Taxonomy, progress, and prospects

K Zhang, Q Wen, C Zhang, R Cai, M Jin… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Self-supervised learning (SSL) has recently achieved impressive performance on various
time series tasks. The most prominent advantage of SSL is that it reduces the dependence …

A survey on time-series pre-trained models

Q Ma, Z Liu, Z Zheng, Z Huang, S Zhu… - … on Knowledge and …, 2024 - ieeexplore.ieee.org
Time-Series Mining (TSM) is an important research area since it shows great potential in
practical applications. Deep learning models that rely on massive labeled data have been …

Simmtm: A simple pre-training framework for masked time-series modeling

J Dong, H Wu, H Zhang, L Zhang… - Advances in Neural …, 2024 - proceedings.neurips.cc
Time series analysis is widely used in extensive areas. Recently, to reduce labeling
expenses and benefit various tasks, self-supervised pre-training has attracted immense …

Tempo: Prompt-based generative pre-trained transformer for time series forecasting

D Cao, F Jia, SO Arik, T Pfister, Y Zheng, W Ye… - arXiv preprint arXiv …, 2023 - arxiv.org
The past decade has witnessed significant advances in time series modeling with deep
learning. While achieving state-of-the-art results, the best-performing architectures vary …

Deep time series models: A comprehensive survey and benchmark

Y Wang, H Wu, J Dong, Y Liu, M Long… - arXiv preprint arXiv …, 2024 - arxiv.org
Time series, characterized by a sequence of data points arranged in a discrete-time order,
are ubiquitous in real-world applications. Different from other modalities, time series present …

Enhancing time series forecasting: a hierarchical transformer with probabilistic decomposition representation

J Tong, L Xie, W Yang, K Zhang, J Zhao - Information Sciences, 2023 - Elsevier
Time series forecasting is crucial for several fields, such as disaster warning, weather
prediction, and energy consumption. Transformer-based models are considered to have …

Drift doesn't matter: dynamic decomposition with diffusion reconstruction for unstable multivariate time series anomaly detection

C Wang, Z Zhuang, Q Qi, J Wang… - Advances in …, 2024 - proceedings.neurips.cc
Many unsupervised methods have recently been proposed for multivariate time series
anomaly detection. However, existing works mainly focus on stable data yet often omit the …

SimTS: rethinking contrastive representation learning for time series forecasting

X Zheng, X Chen, M Schürch, A Mollaysa… - arXiv preprint arXiv …, 2023 - arxiv.org
Contrastive learning methods have shown an impressive ability to learn meaningful
representations for image or time series classification. However, these methods are less …

Rethinking self-supervised learning for time series forecasting: A temporal perspective

S Zhao, X Zhou, M Jin, Z Hou, C Yang, Z Li… - Knowledge-Based …, 2024 - Elsevier
Self-supervised learning has garnered significant attention for its ability to learn meaningful
representations. Recent advancements have introduced self-supervised methods for time …

Timer: Transformers for time series analysis at scale

Y Liu, H Zhang, C Li, X Huang, J Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
Deep learning has contributed remarkably to the advancement of time series analysis. Still,
deep models can encounter performance bottlenecks in real-world small-sample scenarios …