Transformers in time series: A survey

Q Wen, T Zhou, C Zhang, W Chen, Z Ma, J Yan… - arXiv preprint arXiv …, 2022 - arxiv.org
Transformers have achieved superior performances in many tasks in natural language
processing and computer vision, which also triggered great interest in the time series …

Spatio-temporal graph neural networks for predictive learning in urban computing: A survey

G Jin, Y Liang, Y Fang, Z Shao, J Huang… - … on Knowledge and …, 2023 - ieeexplore.ieee.org
With recent advances in sensing technologies, a myriad of spatio-temporal data has been
generated and recorded in smart cities. Forecasting the evolution patterns of spatio-temporal …

Deciphering spatio-temporal graph forecasting: A causal lens and treatment

Y Xia, Y Liang, H Wen, X Liu, K Wang… - Advances in …, 2024 - proceedings.neurips.cc
Abstract Spatio-Temporal Graph (STG) forecasting is a fundamental task in many real-world
applications. Spatio-Temporal Graph Neural Networks have emerged as the most popular …

Large models for time series and spatio-temporal data: A survey and outlook

M Jin, Q Wen, Y Liang, C Zhang, S Xue, X Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Temporal data, notably time series and spatio-temporal data, are prevalent in real-world
applications. They capture dynamic system measurements and are produced in vast …

[HTML][HTML] A systematic survey of air quality prediction based on deep learning

Z Zhang, S Zhang, C Chen, J Yuan - Alexandria Engineering Journal, 2024 - Elsevier
The impact of air pollution on public health is substantial, and accurate long-term predictions
of air quality are crucial for early warning systems to address this issue. Air quality prediction …

Deep learning for cross-domain data fusion in urban computing: Taxonomy, advances, and outlook

X Zou, Y Yan, X Hao, Y Hu, H Wen, E Liu, J Zhang… - Information …, 2025 - Elsevier
As cities continue to burgeon, Urban Computing emerges as a pivotal discipline for
sustainable development by harnessing the power of cross-domain data fusion from diverse …

Diffstg: Probabilistic spatio-temporal graph forecasting with denoising diffusion models

H Wen, Y Lin, Y Xia, H Wan, Q Wen… - Proceedings of the 31st …, 2023 - dl.acm.org
Spatio-temporal graph neural networks (STGNN) have emerged as the dominant model for
spatio-temporal graph (STG) forecasting. Despite their success, they fail to model intrinsic …

[HTML][HTML] GBT: Two-stage transformer framework for non-stationary time series forecasting

L Shen, Y Wei, Y Wang - Neural Networks, 2023 - Elsevier
This paper shows that time series forecasting Transformer (TSFT) suffers from severe over-
fitting problem caused by improper initialization method of unknown decoder inputs …

CARD: Channel aligned robust blend transformer for time series forecasting

X Wang, T Zhou, Q Wen, J Gao, B Ding… - The Twelfth International …, 2024 - openreview.net
Recent studies have demonstrated the great power of Transformer models for time series
forecasting. One of the key elements that lead to the transformer's success is the channel …

Stg-mamba: Spatial-temporal graph learning via selective state space model

L Li, H Wang, W Zhang, A Coster - arXiv preprint arXiv:2403.12418, 2024 - arxiv.org
Spatial-Temporal Graph (STG) data is characterized as dynamic, heterogenous, and non-
stationary, leading to the continuous challenge of spatial-temporal graph learning. In the …