[HTML][HTML] Artificial intelligence for multimodal data integration in oncology

J Lipkova, RJ Chen, B Chen, MY Lu, M Barbieri… - Cancer cell, 2022 - cell.com
In oncology, the patient state is characterized by a whole spectrum of modalities, ranging
from radiology, histology, and genomics to electronic health records. Current artificial …

Transformers in medical imaging: A survey

F Shamshad, S Khan, SW Zamir, MH Khan… - Medical Image …, 2023 - Elsevier
Following unprecedented success on the natural language tasks, Transformers have been
successfully applied to several computer vision problems, achieving state-of-the-art results …

Multimodal learning with transformers: A survey

P Xu, X Zhu, DA Clifton - IEEE Transactions on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Transformer is a promising neural network learner, and has achieved great success in
various machine learning tasks. Thanks to the recent prevalence of multimodal applications …

Scaling vision transformers to gigapixel images via hierarchical self-supervised learning

RJ Chen, C Chen, Y Li, TY Chen… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract Vision Transformers (ViTs) and their multi-scale and hierarchical variations have
been successful at capturing image representations but their use has been generally …

Towards a general-purpose foundation model for computational pathology

RJ Chen, T Ding, MY Lu, DFK Williamson, G Jaume… - Nature Medicine, 2024 - nature.com
Quantitative evaluation of tissue images is crucial for computational pathology (CPath) tasks,
requiring the objective characterization of histopathological entities from whole-slide images …

A visual-language foundation model for computational pathology

MY Lu, B Chen, DFK Williamson, RJ Chen, I Liang… - Nature Medicine, 2024 - nature.com
The accelerated adoption of digital pathology and advances in deep learning have enabled
the development of robust models for various pathology tasks across a diverse array of …

Visual language pretrained multiple instance zero-shot transfer for histopathology images

MY Lu, B Chen, A Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Contrastive visual language pretraining has emerged as a powerful method for either
training new language-aware image encoders or augmenting existing pretrained models …

[HTML][HTML] Toward explainable artificial intelligence for precision pathology

F Klauschen, J Dippel, P Keyl… - Annual Review of …, 2024 - annualreviews.org
The rapid development of precision medicine in recent years has started to challenge
diagnostic pathology with respect to its ability to analyze histological images and …

[HTML][HTML] Fast and scalable search of whole-slide images via self-supervised deep learning

C Chen, MY Lu, DFK Williamson, TY Chen… - Nature Biomedical …, 2022 - nature.com
The adoption of digital pathology has enabled the curation of large repositories of gigapixel
whole-slide images (WSIs). Computationally identifying WSIs with similar morphologic …

Vision Transformers in medical computer vision—A contemplative retrospection

A Parvaiz, MA Khalid, R Zafar, H Ameer, M Ali… - … Applications of Artificial …, 2023 - Elsevier
Abstract Vision Transformers (ViTs), with the magnificent potential to unravel the information
contained within images, have evolved as one of the most contemporary and dominant …