A survey on deep neural network pruning: Taxonomy, comparison, analysis, and recommendations

H Cheng, M Zhang, JQ Shi - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
Modern deep neural networks, particularly recent large language models, come with
massive model sizes that require significant computational and storage resources. To …

[HTML][HTML] Review of image classification algorithms based on convolutional neural networks

L Chen, S Li, Q Bai, J Yang, S Jiang, Y Miao - Remote Sensing, 2021 - mdpi.com
Image classification has always been a hot research direction in the world, and the
emergence of deep learning has promoted the development of this field. Convolutional …

Infogcn: Representation learning for human skeleton-based action recognition

H Chi, MH Ha, S Chi, SW Lee… - Proceedings of the …, 2022 - openaccess.thecvf.com
Human skeleton-based action recognition offers a valuable means to understand the
intricacies of human behavior because it can handle the complex relationships between …

[HTML][HTML] Pre-trained models: Past, present and future

X Han, Z Zhang, N Ding, Y Gu, X Liu, Y Huo, J Qiu… - AI Open, 2021 - Elsevier
Large-scale pre-trained models (PTMs) such as BERT and GPT have recently achieved
great success and become a milestone in the field of artificial intelligence (AI). Owing to …

Single-source domain expansion network for cross-scene hyperspectral image classification

Y Zhang, W Li, W Sun, R Tao… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Currently, cross-scene hyperspectral image (HSI) classification has drawn increasing
attention. It is necessary to train a model only on source domain (SD) and directly …

[HTML][HTML] Embracing change: Continual learning in deep neural networks

R Hadsell, D Rao, AA Rusu, R Pascanu - Trends in cognitive sciences, 2020 - cell.com
Artificial intelligence research has seen enormous progress over the past few decades, but it
predominantly relies on fixed datasets and stationary environments. Continual learning is an …

Wavegrad: Estimating gradients for waveform generation

N Chen, Y Zhang, H Zen, RJ Weiss, M Norouzi… - arXiv preprint arXiv …, 2020 - arxiv.org
This paper introduces WaveGrad, a conditional model for waveform generation which
estimates gradients of the data density. The model is built on prior work on score matching …

Is quantum advantage the right goal for quantum machine learning?

M Schuld, N Killoran - Prx Quantum, 2022 - APS
Machine learning is frequently listed among the most promising applications for quantum
computing. This is in fact a curious choice: the machine-learning algorithms of today are …

[图书][B] The principles of deep learning theory

DA Roberts, S Yaida, B Hanin - 2022 - cambridge.org
This textbook establishes a theoretical framework for understanding deep learning models
of practical relevance. With an approach that borrows from theoretical physics, Roberts and …

Understanding self-supervised learning dynamics without contrastive pairs

Y Tian, X Chen, S Ganguli - International Conference on …, 2021 - proceedings.mlr.press
While contrastive approaches of self-supervised learning (SSL) learn representations by
minimizing the distance between two augmented views of the same data point (positive …