Language models are free boosters for biomedical imaging tasks

Z Lai, J Wu, S Chen, Y Zhou, A Hovakimyan… - arXiv preprint arXiv …, 2024 - arxiv.org
In this study, we uncover the unexpected efficacy of residual-based large language models
(LLMs) as part of encoders for biomedical imaging tasks, a domain traditionally devoid of …

Advancing medical imaging with language models: A journey from n-grams to chatgpt

M Hu, S Pan, Y Li, X Yang - arXiv preprint arXiv:2304.04920, 2023 - arxiv.org
In this paper, we aimed to provide a review and tutorial for researchers in the field of medical
imaging using language models to improve their tasks at hand. We began by providing an …

Tailoring large language models to radiology: A preliminary approach to llm adaptation for a highly specialized domain

Z Liu, A Zhong, Y Li, L Yang, C Ju, Z Wu, C Ma… - … Workshop on Machine …, 2023 - Springer
In this preliminary work, we present a domain fine-tuned LLM model for radiology, an
experimental large language model adapted for radiology. This model, created through an …

Frozen transformers in language models are effective visual encoder layers

Z Pang, Z Xie, Y Man, YX Wang - arXiv preprint arXiv:2310.12973, 2023 - arxiv.org
This paper reveals that large language models (LLMs), despite being trained solely on
textual data, are surprisingly strong encoders for purely visual tasks in the absence of …

Mysterious Projections: Multimodal LLMs Gain Domain-Specific Visual Capabilities Without Richer Cross-Modal Projections

G Verma, M Choi, K Sharma, J Watson-Daniels… - arXiv preprint arXiv …, 2024 - arxiv.org
Multimodal large language models (MLLMs) like LLaVA and GPT-4 (V) enable general-
purpose conversations about images with the language modality. As off-the-shelf MLLMs …

[HTML][HTML] R2gengpt: Radiology report generation with frozen llms

Z Wang, L Liu, L Wang, L Zhou - Meta-Radiology, 2023 - Elsevier
Abstract Large Language Models (LLMs) have consistently showcased remarkable
generalization capa-bilities when applied to various language tasks. Nonetheless …

[HTML][HTML] The role of large language models in medical image processing: a narrative review

D Tian, S Jiang, L Zhang, X Lu, Y Xu - Quantitative Imaging in …, 2024 - ncbi.nlm.nih.gov
Methods A comprehensive literature search was conducted on the Web of Science and
PubMed databases from 2013 to 2023, focusing on the transformations of LLMs in Medical …

Debiasing large visual language models

YF Zhang, W Yu, Q Wen, X Wang, Z Zhang… - arXiv preprint arXiv …, 2024 - arxiv.org
In the realms of computer vision and natural language processing, Large Vision-Language
Models (LVLMs) have become indispensable tools, proficient in generating textual …

[HTML][HTML] Large language models: a guide for radiologists

S Kim, C Lee, S Kim - Korean Journal of Radiology, 2024 - ncbi.nlm.nih.gov
Large language models (LLMs) have revolutionized the global landscape of technology
beyond natural language processing. Owing to their extensive pre-training on vast datasets …

RAD-DINO: Exploring Scalable Medical Image Encoders Beyond Text Supervision

F Pérez-García, H Sharma, S Bond-Taylor… - arXiv preprint arXiv …, 2024 - arxiv.org
Language-supervised pre-training has proven to be a valuable method for extracting
semantically meaningful features from images, serving as a foundational element in …