Pathformer: Multi-scale transformers with adaptive pathways for time series forecasting

P Chen, Y Zhang, Y Cheng, Y Shu, Y Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
Transformer-based models have achieved some success in time series forecasting. Existing
methods mainly model time series from limited or fixed scales, making it challenging to …

CARD: Channel aligned robust blend transformer for time series forecasting

X Wang, T Zhou, Q Wen, J Gao, B Ding… - The Twelfth International …, 2024 - openreview.net
Recent studies have demonstrated the great power of Transformer models for time series
forecasting. One of the key elements that lead to the transformer's success is the channel …

Scaleformer: Iterative multi-scale refining transformers for time series forecasting

A Shabani, A Abdi, L Meng, T Sylvain - arXiv preprint arXiv:2206.04038, 2022 - arxiv.org
The performance of time series forecasting has recently been greatly improved by the
introduction of transformers. In this paper, we propose a general multi-scale framework that …

Hidformer: Hierarchical dual-tower transformer using multi-scale mergence for long-term time series forecasting

Z Liu, Y Cao, H Xu, Y Huang, Q He, X Chen… - Expert Systems with …, 2024 - Elsevier
Long-term time series forecasting has received a lot of popularity because of its great
practicality. It is also an extremely challenging task since it requires using limited …

itransformer: Inverted transformers are effective for time series forecasting

Y Liu, T Hu, H Zhang, H Wu, S Wang, L Ma… - arXiv preprint arXiv …, 2023 - arxiv.org
The recent boom of linear forecasting models questions the ongoing passion for
architectural modifications of Transformer-based forecasters. These forecasters leverage …

Client: Cross-variable linear integrated enhanced transformer for multivariate long-term time series forecasting

J Gao, W Hu, Y Chen - arXiv preprint arXiv:2305.18838, 2023 - arxiv.org
Long-term time series forecasting (LTSF) is a crucial aspect of modern society, playing a
pivotal role in facilitating long-term planning and developing early warning systems. While …

Inparformer: Evolutionary decomposition transformers with interactive parallel attention for long-term time series forecasting

H Cao, Z Huang, T Yao, J Wang, H He… - Proceedings of the AAAI …, 2023 - ojs.aaai.org
Long-term time series forecasting (LTSF) provides substantial benefits for numerous real-
world applications, whereas places essential demands on the model capacity to capture …

TS-Fastformer: Fast Transformer for Time-Series Forecasting

S Lee, J Hong, L Liu, W Choi - ACM Transactions on Intelligent Systems …, 2024 - dl.acm.org
Many real-world applications require precise and fast time-series forecasting. Recent trends
in time-series forecasting models are shifting from LSTM-based models to Transformer …

[PDF][PDF] SMARTformer: Semi-Autoregressive Transformer with Efficient Integrated Window Attention for Long Time Series Forecasting.

Y Li, S Qi, Z Li, Z Rao, L Pan, Z Xu - IJCAI, 2023 - ijcai.org
The success of Transformers in long time series forecasting (LTSF) can be attributed to their
attention mechanisms and non-autoregressive (NAR) decoder structures, which capture …

Tempo: Prompt-based generative pre-trained transformer for time series forecasting

D Cao, F Jia, SO Arik, T Pfister, Y Zheng, W Ye… - arXiv preprint arXiv …, 2023 - arxiv.org
The past decade has witnessed significant advances in time series modeling with deep
learning. While achieving state-of-the-art results, the best-performing architectures vary …