On the challenges and perspectives of foundation models for medical image analysis

S Zhang, D Metaxas - Medical Image Analysis, 2023 - Elsevier
This article discusses the opportunities, applications and future directions of large-scale
pretrained models, ie, foundation models, which promise to significantly improve the …

Segment anything model for medical image segmentation: Current applications and future directions

Y Zhang, Z Shen, R Jiao - Computers in Biology and Medicine, 2024 - Elsevier
Due to the inherent flexibility of prompting, foundation models have emerged as the
predominant force in the fields of natural language processing and computer vision. The …

Segment anything model for medical images?

Y Huang, X Yang, L Liu, H Zhou, A Chang, X Zhou… - Medical Image …, 2024 - Elsevier
Abstract The Segment Anything Model (SAM) is the first foundation model for general image
segmentation. It has achieved impressive results on various natural image segmentation …

Sam-clip: Merging vision foundation models towards semantic and spatial understanding

H Wang, PKA Vasu, F Faghri… - Proceedings of the …, 2024 - openaccess.thecvf.com
The landscape of publicly available vision foundation models (VFMs) such as CLIP and
SAM is expanding rapidly. VFMs are endowed with distinct capabilities stemming from their …

Samaug: Point prompt augmentation for segment anything model

H Dai, C Ma, Z Yan, Z Liu, E Shi, Y Li, P Shu… - arXiv preprint arXiv …, 2023 - arxiv.org
This paper introduces SAMAug, a novel visual point augmentation method for the Segment
Anything Model (SAM) that enhances interactive image segmentation performance …

Zept: Zero-shot pan-tumor segmentation via query-disentangling and self-prompting

Y Jiang, Z Huang, R Zhang… - Proceedings of the …, 2024 - openaccess.thecvf.com
The long-tailed distribution problem in medical image analysis reflects a high prevalence of
common conditions and a low prevalence of rare ones which poses a significant challenge …

3DSAM-adapter: Holistic adaptation of SAM from 2D to 3D for promptable tumor segmentation

S Gong, Y Zhong, W Ma, J Li, Z Wang, J Zhang… - Medical Image …, 2024 - Elsevier
Despite that the segment anything model (SAM) achieved impressive results on general-
purpose semantic segmentation with strong generalization ability on daily images, its …

Holistic evaluation of gpt-4v for biomedical imaging

Z Liu, H Jiang, T Zhong, Z Wu, C Ma, Y Li, X Yu… - arXiv preprint arXiv …, 2023 - arxiv.org
In this paper, we present a large-scale evaluation probing GPT-4V's capabilities and
limitations for biomedical image analysis. GPT-4V represents a breakthrough in artificial …

SC-SSL: Self-correcting Collaborative and Contrastive Co-training Model for Semi-Supervised Medical Image Segmentation

J Miao, SP Zhou, GQ Zhou, KN Wang… - … on Medical Imaging, 2023 - ieeexplore.ieee.org
Image segmentation achieves significant improvements with deep neural networks at the
premise of a large scale of labeled training data, which is laborious to assure in medical …

Sa-med2d-20m dataset: Segment anything in 2d medical imaging with 20 million masks

J Ye, J Cheng, J Chen, Z Deng, T Li, H Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Segment Anything Model (SAM) has achieved impressive results for natural image
segmentation with input prompts such as points and bounding boxes. Its success largely …