A recent survey of vision transformers for medical image segmentation

A Khan, Z Rauf, AR Khan, S Rathore, SH Khan… - arXiv preprint arXiv …, 2023 - arxiv.org
Medical image segmentation plays a crucial role in various healthcare applications,
enabling accurate diagnosis, treatment planning, and disease monitoring. Traditionally …

Optimizing vision transformers for medical image segmentation

Q Liu, C Kaul, J Wang… - ICASSP 2023-2023 …, 2023 - ieeexplore.ieee.org
For medical image semantic segmentation (MISS), Vision Transformers have emerged as
strong alternatives to convolutional neural networks thanks to their inherent ability to capture …

Mdvit: Multi-domain vision transformer for small medical image segmentation datasets

S Du, N Bayasi, G Hamarneh, R Garbi - International Conference on …, 2023 - Springer
Despite its clinical utility, medical image segmentation (MIS) remains a daunting task due to
images' inherent complexity and variability. Vision transformers (ViTs) have recently …

Unetformer: A unified vision transformer model and pre-training framework for 3d medical image segmentation

A Hatamizadeh, Z Xu, D Yang, W Li, H Roth… - arXiv preprint arXiv …, 2022 - arxiv.org
Vision Transformers (ViT) s have recently become popular due to their outstanding modeling
capabilities, in particular for capturing long-range information, and scalability to dataset and …

ConvFormer: Plug-and-play CNN-style transformers for improving medical image segmentation

X Lin, Z Yan, X Deng, C Zheng, L Yu - International Conference on …, 2023 - Springer
Transformers have been extensively studied in medical image segmentation to build
pairwise long-range dependence. Yet, relatively limited well-annotated medical image data …

A data-scalable transformer for medical image segmentation: architecture, model efficiency, and benchmark

Y Gao, M Zhou, D Liu, Z Yan, S Zhang… - arXiv preprint arXiv …, 2022 - arxiv.org
Transformers have demonstrated remarkable performance in natural language processing
and computer vision. However, existing vision Transformers struggle to learn from limited …

Contrans: Improving transformer with convolutional attention for medical image segmentation

A Lin, J Xu, J Li, G Lu - … Conference on Medical Image Computing and …, 2022 - Springer
Over the past few years, convolution neural networks (CNNs) and vision transformers (ViTs)
have been two dominant architectures in medical image segmentation. Although CNNs can …

SMESwin Unet: Merging CNN and transformer for medical image segmentation

Z Wang, X Min, F Shi, R Jin, SS Nawrin, I Yu… - … Conference on Medical …, 2022 - Springer
Vision transformer is the new favorite paradigm in medical image segmentation since last
year, which surpassed the traditional CNN counterparts in quantitative metrics. The …

Hybrid CNN-Transformer model for medical image segmentation with pyramid convolution and multi-layer perceptron

X Liu, Y Hu, J Chen - Biomedical Signal Processing and Control, 2023 - Elsevier
Abstract Vision Transformer (ViT) has emerged as a potential alternative to convolutional
neural networks for large datasets. However, applying ViT directly to medical image …

ScaleFormer: revisiting the transformer-based backbones from a scale-wise perspective for medical image segmentation

H Huang, S Xie, L Lin, Y Iwamoto, X Han… - arXiv preprint arXiv …, 2022 - arxiv.org
Recently, a variety of vision transformers have been developed as their capability of
modeling long-range dependency. In current transformer-based backbones for medical …