Transformers in medical imaging: A survey

F Shamshad, S Khan, SW Zamir, MH Khan… - Medical Image …, 2023 - Elsevier
Following unprecedented success on the natural language tasks, Transformers have been
successfully applied to several computer vision problems, achieving state-of-the-art results …

The neuroconnectionist research programme

A Doerig, RP Sommers, K Seeliger… - Nature Reviews …, 2023 - nature.com
Artificial neural networks (ANNs) inspired by biology are beginning to be widely used to
model behavioural and neural data, an approach we call 'neuroconnectionism'. ANNs have …

Scaling up your kernels to 31x31: Revisiting large kernel design in cnns

X Ding, X Zhang, J Han, G Ding - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
We revisit large kernel design in modern convolutional neural networks (CNNs). Inspired by
recent advances in vision transformers (ViTs), in this paper, we demonstrate that using a few …

nnformer: Volumetric medical image segmentation via a 3d transformer

HY Zhou, J Guo, Y Zhang, X Han, L Yu… - … on Image Processing, 2023 - ieeexplore.ieee.org
Transformer, the model of choice for natural language processing, has drawn scant attention
from the medical imaging community. Given the ability to exploit long-term dependencies …

Mpvit: Multi-path vision transformer for dense prediction

Y Lee, J Kim, J Willette… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Dense computer vision tasks such as object detection and segmentation require effective
multi-scale feature representation for detecting or classifying objects or regions with varying …

Intriguing properties of vision transformers

MM Naseer, K Ranasinghe, SH Khan… - Advances in …, 2021 - proceedings.neurips.cc
Vision transformers (ViT) have demonstrated impressive performance across numerous
machine vision tasks. These models are based on multi-head self-attention mechanisms that …

nnformer: Interleaved transformer for volumetric segmentation

HY Zhou, J Guo, Y Zhang, L Yu, L Wang… - arXiv preprint arXiv …, 2021 - arxiv.org
Transformer, the model of choice for natural language processing, has drawn scant attention
from the medical imaging community. Given the ability to exploit long-term dependencies …

UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio Video Point Cloud Time-Series and Image Recognition

X Ding, Y Zhang, Y Ge, S Zhao… - Proceedings of the …, 2024 - openaccess.thecvf.com
Large-kernel convolutional neural networks (ConvNets) have recently received extensive
research attention but two unresolved and critical issues demand further investigation. 1) …

Partial success in closing the gap between human and machine vision

R Geirhos, K Narayanappa, B Mitzkus… - Advances in …, 2021 - proceedings.neurips.cc
A few years ago, the first CNN surpassed human performance on ImageNet. However, it
soon became clear that machines lack robustness on more challenging test cases, a major …

The best game in town: The reemergence of the language-of-thought hypothesis across the cognitive sciences

J Quilty-Dunn, N Porot, E Mandelbaum - Behavioral and Brain …, 2023 - cambridge.org
Mental representations remain the central posits of psychology after many decades of
scrutiny. However, there is no consensus about the representational format (s) of biological …