Literature review of deep network compression

A Alqahtani, X Xie, MW Jones - Informatics, 2021 - mdpi.com
Deep networks often possess a vast number of parameters, and their significant redundancy
in parameterization has become a widely-recognized property. This presents significant …

[HTML][HTML] Intelligent oncology: The convergence of artificial intelligence and oncology

B Lin, Z Tan, Y Mo, X Yang, Y Liu, B Xu - Journal of the National Cancer …, 2023 - Elsevier
With increasingly explored ideologies and technologies for potential applications of artificial
intelligence (AI) in oncology, we here describe a holistic and structured concept termed …

An online-learning-enabled self-attention-based model for ultra-short-term wind power forecasting

X Dai, GP Liu, W Hu - Energy, 2023 - Elsevier
Renewable wind power accounts for an increasing proportion of the smart grid nowadays.
The intermittent and fluctuating nature of wind renders wind power forecasting important …

TransCL: Transformer makes strong and flexible compressive learning

C Mou, J Zhang - IEEE Transactions on Pattern Analysis and …, 2022 - ieeexplore.ieee.org
Compressive learning (CL) is an emerging framework that integrates signal acquisition via
compressed sensing (CS) and machine learning for inference tasks directly on a small …

Renewable energy forecasting: A self-supervised learning-based transformer variant

J Liu, Y Fu - Energy, 2023 - Elsevier
Reliable and accurate renewable energy forecasting (REF) has substantial impact on
society by helping with daily planning and mitigating the instability of power system …

Sketch transformer: Asymmetrical disentanglement learning from dynamic synthesis

C Chen, M Ye, M Qi, B Du - Proceedings of the 30th ACM International …, 2022 - dl.acm.org
Sketch-photo recognition is a cross-modal matching problem whose query sets are sketch
images drawn by artists or amateurs. Due to the significant modality difference between the …

SketchTrans: Disentangled prototype learning with transformer for sketch-photo recognition

C Chen, M Ye, M Qi, B Du - IEEE Transactions on Pattern …, 2023 - ieeexplore.ieee.org
Matching hand-drawn sketches with photos (aka sketch-photo recognition or re-
identification) faces the information asymmetry challenge due to the abstract nature of the …

Seeking common but distinguishing difference, a joint aspect-based sentiment analysis model

H Jing, Z Li, H Zhao, S Jiang - arXiv preprint arXiv:2111.09634, 2021 - arxiv.org
Aspect-based sentiment analysis (ABSA) task consists of three typical subtasks: aspect term
extraction, opinion term extraction, and sentiment polarity classification. These three …

Structural pre-training for dialogue comprehension

Z Zhang, H Zhao - arXiv preprint arXiv:2105.10956, 2021 - arxiv.org
Pre-trained language models (PrLMs) have demonstrated superior performance due to their
strong ability to learn universal language representations from self-supervised pre-training …

Transformer-based reinforcement learning for pickup and delivery problems with late penalties

K Zhang, X Lin, M Li - IEEE Transactions on Intelligent …, 2022 - ieeexplore.ieee.org
Pickup and delivery problems with late penalties can be adopted to model a wide range of
practical situations in the field of transportation and logistics. However, the restrictions on the …