A review on the attention mechanism of deep learning

Z Niu, G Zhong, H Yu - Neurocomputing, 2021 - Elsevier
Attention has arguably become one of the most important concepts in the deep learning
field. It is inspired by the biological systems of humans that tend to focus on the distinctive …

[HTML][HTML] Deep learning attention mechanism in medical image analysis: Basics and beyonds

X Li, M Li, P Yan, G Li, Y Jiang, H Luo… - International Journal of …, 2023 - sciltp.com
With the improvement of hardware computing power and the development of deep learning
algorithms, a revolution of" artificial intelligence (AI)+ medical image" is taking place …

Prompt distribution learning

Y Lu, J Liu, Y Zhang, Y Liu… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
We present prompt distribution learning for effectively adapting a pre-trained vision-
language model to address downstream recognition tasks. Our method not only learns low …

Dynamic neural networks: A survey

Y Han, G Huang, S Song, L Yang… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Dynamic neural network is an emerging research topic in deep learning. Compared to static
models which have fixed computational graphs and parameters at the inference stage …

Fine-grained image analysis with deep learning: A survey

XS Wei, YZ Song, O Mac Aodha, J Wu… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Fine-grained image analysis (FGIA) is a longstanding and fundamental problem in computer
vision and pattern recognition, and underpins a diverse set of real-world applications. The …

Rotate to attend: Convolutional triplet attention module

D Misra, T Nalamada… - Proceedings of the …, 2021 - openaccess.thecvf.com
Benefiting from the capability of building inter-dependencies among channels or spatial
locations, attention mechanisms have been extensively studied and broadly used in a …

Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI

AB Arrieta, N Díaz-Rodríguez, J Del Ser, A Bennetot… - Information fusion, 2020 - Elsevier
In the last few years, Artificial Intelligence (AI) has achieved a notable momentum that, if
harnessed appropriately, may deliver the best of expectations over many application sectors …

On the detection of digital face manipulation

H Dang, F Liu, J Stehouwer, X Liu… - Proceedings of the …, 2020 - openaccess.thecvf.com
Detecting manipulated facial images and videos is an increasingly important topic in digital
media forensics. As advanced face synthesis and manipulation methods are made …

Hierarchical deep click feature prediction for fine-grained image recognition

J Yu, M Tan, H Zhang, Y Rui… - IEEE transactions on …, 2019 - ieeexplore.ieee.org
The click feature of an image, defined as the user click frequency vector of the image on a
predefined word vocabulary, is known to effectively reduce the semantic gap for fine-grained …

Attention, please! A survey of neural attention models in deep learning

A de Santana Correia, EL Colombini - Artificial Intelligence Review, 2022 - Springer
In humans, Attention is a core property of all perceptual and cognitive operations. Given our
limited ability to process competing sources, attention mechanisms select, modulate, and …