Advancing multimodal medical capabilities of Gemini

L Yang, S Xu, A Sellergren, T Kohlberger… - arXiv preprint arXiv …, 2024 - arxiv.org
Many clinical tasks require an understanding of specialized data, such as medical images
and genomics, which is not typically found in general-purpose large multimodal models …

Towards generalist biomedical AI

T Tu, S Azizi, D Driess, M Schaekermann, M Amin… - NEJM AI, 2024 - ai.nejm.org
Background Medicine is inherently multimodal, requiring the simultaneous interpretation
and integration of insights between many data modalities spanning text, imaging, genomics …

Can gpt-4v (ision) serve medical applications? case studies on gpt-4v for multimodal medical diagnosis

C Wu, J Lei, Q Zheng, W Zhao, W Lin, X Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Driven by the large foundation models, the development of artificial intelligence has
witnessed tremendous progress lately, leading to a surge of general interest from the public …

Towards generalist foundation model for radiology

C Wu, X Zhang, Y Zhang, Y Wang, W Xie - arXiv preprint arXiv:2308.02463, 2023 - arxiv.org
In this study, we aim to initiate the development of Radiology Foundation Model, termed as
RadFM. We consider the construction of foundational models from the perspectives of data …

MiniGPT-Med: Large Language Model as a General Interface for Radiology Diagnosis

A Alkhaldi, R Alnajim, L Alabdullatef, R Alyahya… - arXiv preprint arXiv …, 2024 - arxiv.org
Recent advancements in artificial intelligence (AI) have precipitated significant
breakthroughs in healthcare, particularly in refining diagnostic procedures. However …

Chest imagenome dataset for clinical reasoning

JT Wu, NN Agu, I Lourentzou, A Sharma… - arXiv preprint arXiv …, 2021 - arxiv.org
Despite the progress in automatic detection of radiologic findings from chest X-ray (CXR)
images in recent years, a quantitative evaluation of the explainability of these models is …

A Generalist Learner for Multifaceted Medical Image Interpretation

HY Zhou, S Adithan, JN Acosta, EJ Topol… - arXiv preprint arXiv …, 2024 - arxiv.org
Current medical artificial intelligence systems are often limited to narrow applications,
hindering their widespread adoption in clinical practice. To address this limitation, we …

[HTML][HTML] Evaluating ChatGPT-4's Diagnostic Accuracy: Impact of Visual Data Integration

T Hirosawa, Y Harada, K Tokumasu, T Ito… - JMIR Medical …, 2024 - medinform.jmir.org
Background: In the evolving field of health care, multimodal generative artificial intelligence
(AI) systems, such as ChatGPT-4 with vision (ChatGPT-4V), represent a significant …

Capabilities of gemini models in medicine

K Saab, T Tu, WH Weng, R Tanno, D Stutz… - arXiv preprint arXiv …, 2024 - arxiv.org
Excellence in a wide variety of medical applications poses considerable challenges for AI,
requiring advanced reasoning, access to up-to-date medical knowledge and understanding …

Democratizing ai

B Allen, S Agarwal, J Kalpathy-Cramer… - Journal of the American …, 2019 - Elsevier
Whether it is adjusting parameters for MR pulse sequences, specifying parameters to
optimize radiation exposure on CT scanners, or programming complex treatment planning …