Omnimedvqa: A new large-scale comprehensive evaluation benchmark for medical lvlm

Y Hu, T Li, Q Lu, W Shao, J He… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Large Vision-Language Models (LVLMs) have demonstrated remarkable
capabilities in various multimodal tasks. However their potential in the medical domain …

[HTML][HTML] A review of deep learning-based information fusion techniques for multimodal medical image classification

Y Li, MEH Daho, PH Conze, R Zeghlache… - Computers in Biology …, 2024 - Elsevier
Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it
combines information from various imaging modalities to provide a more comprehensive …

Clinically labeled contrastive learning for oct biomarker classification

K Kokilepersaud, ST Corona… - IEEE Journal of …, 2023 - ieeexplore.ieee.org
This article presents a novel positive and negative set selection strategy for contrastive
learning of medical images based on labels that can be extracted from clinical data. In the …

[HTML][HTML] A Clinician's Guide to Sharing Data for AI in Ophthalmology

N Gim, Y Wu, M Blazes, CS Lee… - … & Visual Science, 2024 - tvst.arvojournals.org
Data is the cornerstone of using AI models, because their performance directly depends on
the diversity, quantity, and quality of the data used for training. Using AI presents unique …

Confidence-aware multi-modality learning for eye disease screening

K Zou, T Lin, Z Han, M Wang, X Yuan, H Chen… - Medical Image …, 2024 - Elsevier
Multi-modal ophthalmic image classification plays a key role in diagnosing eye diseases, as
it integrates information from different sources to complement their respective performances …

On the ramifications of human label uncertainty

C Zhou, M Prabhushankar, G AlRegib - arXiv preprint arXiv:2211.05871, 2022 - arxiv.org
Humans exhibit disagreement during data labeling. We term this disagreement as human
label uncertainty. In this work, we study the ramifications of human label uncertainty (HLU) …

Clinical trial active learning

Z Fowler, KP Kokilepersaud, M Prabhushankar… - Proceedings of the 14th …, 2023 - dl.acm.org
This paper presents a novel approach to active learning that takes into account the non-
independent and identically distributed (non-iid) structure of a clinical trial setting. There …

[HTML][HTML] Stochastic surprisal: An inferential measurement of free energy in neural networks

M Prabhushankar, G AlRegib - Frontiers in Neuroscience, 2023 - frontiersin.org
This paper conjectures and validates a framework that allows for action during inference in
supervised neural networks. Supervised neural networks are constructed with the objective …

Transformer-based end-to-end classification of variable-length volumetric data

M Oghbaie, T Araújo, T Emre, U Schmidt-Erfurth… - … Conference on Medical …, 2023 - Springer
The automatic classification of 3D medical data is memory-intensive. Also, variations in the
number of slices between samples is common. Naïve solutions such as subsampling can …

Clinical contrastive learning for biomarker detection

K Kokilepersaud, M Prabhushankar… - arXiv preprint arXiv …, 2022 - arxiv.org
This paper presents a novel positive and negative set selection strategy for contrastive
learning of medical images based on labels that can be extracted from clinical data. In the …