Self-supervised learning for time series analysis: Taxonomy, progress, and prospects

K Zhang, Q Wen, C Zhang, R Cai, M Jin… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Self-supervised learning (SSL) has recently achieved impressive performance on various
time series tasks. The most prominent advantage of SSL is that it reduces the dependence …

Deep learning for time series classification and extrinsic regression: A current survey

N Mohammadi Foumani, L Miller, CW Tan… - ACM Computing …, 2024 - dl.acm.org
Time Series Classification and Extrinsic Regression are important and challenging machine
learning tasks. Deep learning has revolutionized natural language processing and computer …

Self-supervised contrastive pre-training for time series via time-frequency consistency

X Zhang, Z Zhao, T Tsiligkaridis… - Advances in Neural …, 2022 - proceedings.neurips.cc
Pre-training on time series poses a unique challenge due to the potential mismatch between
pre-training and target domains, such as shifts in temporal dynamics, fast-evolving trends …

Ts2vec: Towards universal representation of time series

Z Yue, Y Wang, J Duan, T Yang, C Huang… - Proceedings of the …, 2022 - ojs.aaai.org
This paper presents TS2Vec, a universal framework for learning representations of time
series in an arbitrary semantic level. Unlike existing methods, TS2Vec performs contrastive …

Unsupervised time-series representation learning with iterative bilinear temporal-spectral fusion

L Yang, S Hong - International conference on machine …, 2022 - proceedings.mlr.press
Unsupervised/self-supervised time series representation learning is a challenging problem
because of its complex dynamics and sparse annotations. Existing works mainly adopt the …

Learning latent seasonal-trend representations for time series forecasting

Z Wang, X Xu, W Zhang, G Trajcevski… - Advances in …, 2022 - proceedings.neurips.cc
Forecasting complex time series is ubiquitous and vital in a range of applications but
challenging. Recent advances endeavor to achieve progress by incorporating various deep …

TEST: Text prototype aligned embedding to activate LLM's ability for time series

C Sun, H Li, Y Li, S Hong - arXiv preprint arXiv:2308.08241, 2023 - arxiv.org
This work summarizes two ways to accomplish Time-Series (TS) tasks in today's Large
Language Model (LLM) context: LLM-for-TS (model-centric) designs and trains a …

Tsmixer: Lightweight mlp-mixer model for multivariate time series forecasting

V Ekambaram, A Jati, N Nguyen, P Sinthong… - Proceedings of the 29th …, 2023 - dl.acm.org
Transformers have gained popularity in time series forecasting for their ability to capture
long-sequence interactions. However, their memory and compute-intensive requirements …

Cocoa: Cross modality contrastive learning for sensor data

S Deldari, H Xue, A Saeed, DV Smith… - Proceedings of the ACM …, 2022 - dl.acm.org
Self-Supervised Learning (SSL) is a new paradigm for learning discriminative
representations without labeled data, and has reached comparable or even state-of-the-art …

Assessing the state of self-supervised human activity recognition using wearables

H Haresamudram, I Essa, T Plötz - … of the ACM on Interactive, Mobile …, 2022 - dl.acm.org
The emergence of self-supervised learning in the field of wearables-based human activity
recognition (HAR) has opened up opportunities to tackle the most pressing challenges in the …