Maira-1: A specialised large multimodal model for radiology report generation

SL Hyland, S Bannur, K Bouzid, DC Castro… - arXiv preprint arXiv …, 2023 - arxiv.org
We present a radiology-specific multimodal model for the task for generating radiological
reports from chest X-rays (CXRs). Our work builds on the idea that large language model (s) …

[HTML][HTML] Radiology report generation with a learned knowledge base and multi-modal alignment

S Yang, X Wu, S Ge, Z Zheng, SK Zhou, L Xiao - Medical Image Analysis, 2023 - Elsevier
In clinics, a radiology report is crucial for guiding a patient's treatment. However, writing
radiology reports is a heavy burden for radiologists. To this end, we present an automatic …

Style-aware radiology report generation with radgraph and few-shot prompting

B Yan, R Liu, DE Kuo, S Adithan, EP Reis… - arXiv preprint arXiv …, 2023 - arxiv.org
Automatically generated reports from medical images promise to improve the workflow of
radiologists. Existing methods consider an image-to-report modeling task by directly …

RaDialog: A large vision-language model for radiology report generation and conversational assistance

C Pellegrini, E Özsoy, B Busam, N Navab… - arXiv preprint arXiv …, 2023 - arxiv.org
Conversational AI tools that can generate and discuss clinically correct radiology reports for
a given medical image have the potential to transform radiology. Such a human-in-the-loop …

Clinically accurate chest x-ray report generation

G Liu, TMH Hsu, M McDermott… - Machine Learning …, 2019 - proceedings.mlr.press
The automatic generation of radiology reports given medical radiographs has significant
potential to operationally and improve clinical patient care. A number of prior works have …

Learning to generate clinically coherent chest X-ray reports

J Lovelace, B Mortazavi - Findings of the association for …, 2020 - aclanthology.org
Automated radiology report generation has the potential to reduce the time clinicians spend
manually reviewing radiographs and streamline clinical care. However, past work has …

Cross-modal prototype driven network for radiology report generation

J Wang, A Bhalerao, Y He - European Conference on Computer Vision, 2022 - Springer
Radiology report generation (RRG) aims to describe automatically a radiology image with
human-like language and could potentially support the work of radiologists, reducing the …

Roentgen: vision-language foundation model for chest x-ray generation

P Chambon, C Bluethgen, JB Delbrouck… - arXiv preprint arXiv …, 2022 - arxiv.org
Multimodal models trained on large natural image-text pair datasets have exhibited
astounding abilities in generating high-quality images. Medical imaging data is …

Retrieval augmented chest x-ray report generation using openai gpt models

M Ranjit, G Ganapathy, R Manuel… - Machine Learning for …, 2023 - proceedings.mlr.press
Abstract We propose Retrieval Augmented Generation (RAG) as an approach for automated
radiology report writing, using multimodally-aligned embeddings from a contrastively …

Baselines for chest x-ray report generation

W Boag, TMH Hsu, M McDermott… - … learning for health …, 2020 - proceedings.mlr.press
With advances in deep learning and image captioning over the past few years, researchers
have recently begun applying computer vision methods to radiology report generation …