Transformers in time series: A survey

Q Wen, T Zhou, C Zhang, W Chen, Z Ma, J Yan… - arXiv preprint arXiv …, 2022 - arxiv.org
Transformers have achieved superior performances in many tasks in natural language
processing and computer vision, which also triggered great interest in the time series …

Spatio-temporal graph neural networks for predictive learning in urban computing: A survey

G Jin, Y Liang, Y Fang, Z Shao, J Huang… - … on Knowledge and …, 2023 - ieeexplore.ieee.org
With recent advances in sensing technologies, a myriad of spatio-temporal data has been
generated and recorded in smart cities. Forecasting the evolution patterns of spatio-temporal …

Deciphering spatio-temporal graph forecasting: A causal lens and treatment

Y Xia, Y Liang, H Wen, X Liu, K Wang… - Advances in …, 2024 - proceedings.neurips.cc
Abstract Spatio-Temporal Graph (STG) forecasting is a fundamental task in many real-world
applications. Spatio-Temporal Graph Neural Networks have emerged as the most popular …

Large models for time series and spatio-temporal data: A survey and outlook

M Jin, Q Wen, Y Liang, C Zhang, S Xue, X Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Temporal data, notably time series and spatio-temporal data, are prevalent in real-world
applications. They capture dynamic system measurements and are produced in vast …

[HTML][HTML] A systematic survey of air quality prediction based on deep learning

Z Zhang, S Zhang, C Chen, J Yuan - Alexandria Engineering Journal, 2024 - Elsevier
The impact of air pollution on public health is substantial, and accurate long-term predictions
of air quality are crucial for early warning systems to address this issue. Air quality prediction …

Diffstg: Probabilistic spatio-temporal graph forecasting with denoising diffusion models

H Wen, Y Lin, Y Xia, H Wan, Q Wen… - Proceedings of the 31st …, 2023 - dl.acm.org
Spatio-temporal graph neural networks (STGNN) have emerged as the dominant model for
spatio-temporal graph (STG) forecasting. Despite their success, they fail to model intrinsic …

[HTML][HTML] GBT: Two-stage transformer framework for non-stationary time series forecasting

L Shen, Y Wei, Y Wang - Neural Networks, 2023 - Elsevier
This paper shows that time series forecasting Transformer (TSFT) suffers from severe over-
fitting problem caused by improper initialization method of unknown decoder inputs …

CARD: Channel aligned robust blend transformer for time series forecasting

X Wang, T Zhou, Q Wen, J Gao, B Ding… - The Twelfth International …, 2024 - openreview.net
Recent studies have demonstrated the great power of Transformer models for time series
forecasting. One of the key elements that lead to the transformer's success is the channel …

Stg-mamba: Spatial-temporal graph learning via selective state space model

L Li, H Wang, W Zhang, A Coster - arXiv preprint arXiv:2403.12418, 2024 - arxiv.org
Spatial-Temporal Graph (STG) data is characterized as dynamic, heterogenous, and non-
stationary, leading to the continuous challenge of spatial-temporal graph learning. In the …

Group-aware graph neural network for nationwide city air quality forecasting

L Chen, J Xu, B Wu, J Huang - ACM Transactions on Knowledge …, 2023 - dl.acm.org
The problem of air pollution threatens public health. Air quality forecasting can provide the
air quality index hours or even days later, which can help the public to prevent air pollution …