Self-supervised learning for time series analysis: Taxonomy, progress, and prospects

K Zhang, Q Wen, C Zhang, R Cai, M Jin… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Self-supervised learning (SSL) has recently achieved impressive performance on various
time series tasks. The most prominent advantage of SSL is that it reduces the dependence …

A survey on time-series pre-trained models

Q Ma, Z Liu, Z Zheng, Z Huang, S Zhu, Z Yu… - arXiv preprint arXiv …, 2023 - arxiv.org
Time-Series Mining (TSM) is an important research area since it shows great potential in
practical applications. Deep learning models that rely on massive labeled data have been …

Time-llm: Time series forecasting by reprogramming large language models

M Jin, S Wang, L Ma, Z Chu, JY Zhang, X Shi… - arXiv preprint arXiv …, 2023 - arxiv.org
Time series forecasting holds significant importance in many real-world dynamic systems
and has been extensively studied. Unlike natural language process (NLP) and computer …

Large models for time series and spatio-temporal data: A survey and outlook

M Jin, Q Wen, Y Liang, C Zhang, S Xue, X Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Temporal data, notably time series and spatio-temporal data, are prevalent in real-world
applications. They capture dynamic system measurements and are produced in vast …

Cocoa: Cross modality contrastive learning for sensor data

S Deldari, H Xue, A Saeed, DV Smith… - Proceedings of the ACM …, 2022 - dl.acm.org
Self-Supervised Learning (SSL) is a new paradigm for learning discriminative
representations without labeled data, and has reached comparable or even state-of-the-art …

Geographic mapping with unsupervised multi-modal representation learning from VHR images and POIs

L Bai, W Huang, X Zhang, S Du, G Cong… - ISPRS Journal of …, 2023 - Elsevier
Most supervised geographic mapping methods with very-high-resolution (VHR) images are
designed for a specific task, leading to high label-dependency and inadequate task …

MHCCL: masked hierarchical cluster-wise contrastive learning for multivariate time series

Q Meng, H Qian, Y Liu, L Cui, Y Xu… - Proceedings of the AAAI …, 2023 - ojs.aaai.org
Learning semantic-rich representations from raw unlabeled time series data is critical for
downstream tasks such as classification and forecasting. Contrastive learning has recently …

Self-supervised multimodal learning: A survey

Y Zong, O Mac Aodha, T Hospedales - arXiv preprint arXiv:2304.01008, 2023 - arxiv.org
Multimodal learning, which aims to understand and analyze information from multiple
modalities, has achieved substantial progress in the supervised regime in recent years …

Label-efficient time series representation learning: A review

E Eldele, M Ragab, Z Chen, M Wu… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Label-efficient time series representation learning, which aims to learn effective
representations with limited labeled data, is crucial for deploying deep learning models in …

Unsupervised representation learning for time series: A review

Q Meng, H Qian, Y Liu, Y Xu, Z Shen, L Cui - arXiv preprint arXiv …, 2023 - arxiv.org
Unsupervised representation learning approaches aim to learn discriminative feature
representations from unlabeled data, without the requirement of annotating every sample …