Attention mechanisms in computer vision: A survey

MH Guo, TX Xu, JJ Liu, ZN Liu, PT Jiang, TJ Mu… - Computational visual …, 2022 - Springer
Humans can naturally and effectively find salient regions in complex scenes. Motivated by
this observation, attention mechanisms were introduced into computer vision with the aim of …

Emergent correspondence from image diffusion

L Tang, M Jia, Q Wang, CP Phoo… - Advances in Neural …, 2023 - proceedings.neurips.cc
Finding correspondences between images is a fundamental problem in computer vision. In
this paper, we show that correspondence emerges in image diffusion models without any …

Fine-grained image analysis with deep learning: A survey

XS Wei, YZ Song, O Mac Aodha, J Wu… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Fine-grained image analysis (FGIA) is a longstanding and fundamental problem in computer
vision and pattern recognition, and underpins a diverse set of real-world applications. The …

Graphsmote: Imbalanced node classification on graphs with graph neural networks

T Zhao, X Zhang, S Wang - Proceedings of the 14th ACM international …, 2021 - dl.acm.org
Node classification is an important research topic in graph learning. Graph neural networks
(GNNs) have achieved state-of-the-art performance of node classification. However, existing …

Deep learning enables accurate diagnosis of novel coronavirus (COVID-19) with CT images

Y Song, S Zheng, L Li, X Zhang… - … ACM transactions on …, 2021 - ieeexplore.ieee.org
A novel coronavirus (COVID-19) recently emerged as an acute respiratory syndrome, and
has caused a pneumonia outbreak world-widely. As the COVID-19 continues to spread …

Gpipe: Efficient training of giant neural networks using pipeline parallelism

Y Huang, Y Cheng, A Bapna, O Firat… - Advances in neural …, 2019 - proceedings.neurips.cc
Scaling up deep neural network capacity has been known as an effective approach to
improving model quality for several different machine learning tasks. In many cases …

Classification of remote sensing images using EfficientNet-B3 CNN model with attention

H Alhichri, AS Alswayed, Y Bazi, N Ammour… - IEEE …, 2021 - ieeexplore.ieee.org
Scene classification is a highly useful task in Remote Sensing (RS) applications. Many
efforts have been made to improve the accuracy of RS scene classification. Scene …

Relational knowledge distillation

W Park, D Kim, Y Lu, M Cho - Proceedings of the IEEE/CVF …, 2019 - openaccess.thecvf.com
Abstract Knowledge distillation aims at transferring knowledge acquired in one model (a
teacher) to another model (a student) that is typically smaller. Previous approaches can be …

Delving deep into label smoothing

CB Zhang, PT Jiang, Q Hou, Y Wei… - … on Image Processing, 2021 - ieeexplore.ieee.org
Label smoothing is an effective regularization tool for deep neural networks (DNNs), which
generates soft labels by applying a weighted average between the uniform distribution and …

Attention, please! A survey of neural attention models in deep learning

A de Santana Correia, EL Colombini - Artificial Intelligence Review, 2022 - Springer
In humans, Attention is a core property of all perceptual and cognitive operations. Given our
limited ability to process competing sources, attention mechanisms select, modulate, and …