A survey of large language models in medicine: Progress, application, and challenge

H Zhou, B Gu, X Zou, Y Li, SS Chen, P Zhou… - arXiv preprint arXiv …, 2023 - arxiv.org
Large language models (LLMs), such as ChatGPT, have achieved substantial attention due
to their impressive human language understanding and generation capabilities. Therefore …

[HTML][HTML] Generalist vision foundation models for medical imaging: A case study of segment anything model on zero-shot medical segmentation

P Shi, J Qiu, SMD Abaxi, H Wei, FPW Lo, W Yuan - Diagnostics, 2023 - mdpi.com
Medical image analysis plays an important role in clinical diagnosis. In this paper, we
examine the recent Segment Anything Model (SAM) on medical images, and report both …

Large models for time series and spatio-temporal data: A survey and outlook

M Jin, Q Wen, Y Liang, C Zhang, S Xue, X Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Temporal data, notably time series and spatio-temporal data, are prevalent in real-world
applications. They capture dynamic system measurements and are produced in vast …

Sparks of large audio models: A survey and outlook

S Latif, M Shoukat, F Shamshad, M Usama… - arXiv preprint arXiv …, 2023 - arxiv.org
This survey paper provides a comprehensive overview of the recent advancements and
challenges in applying large language models to the field of audio signal processing. Audio …

Chatcad+: Towards a universal and reliable interactive cad using llms

Z Zhao, S Wang, J Gu, Y Zhu, L Mei… - … on Medical Imaging, 2024 - ieeexplore.ieee.org
The integration of Computer-Aided Diagnosis (CAD) with Large Language Models (LLMs)
presents a promising frontier in clinical applications, notably in automating diagnostic …

One prompt word is enough to boost adversarial robustness for pre-trained vision-language models

L Li, H Guan, J Qiu, M Spratling - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Abstract Large pre-trained Vision-Language Models (VLMs) like CLIP despite having
remarkable generalization ability are highly vulnerable to adversarial examples. This work …

Ehrshot: An ehr benchmark for few-shot evaluation of foundation models

M Wornow, R Thapa, E Steinberg… - Advances in Neural …, 2024 - proceedings.neurips.cc
While the general machine learning (ML) community has benefited from public datasets,
tasks, and models, the progress of ML in healthcare has been hampered by a lack of such …

Foundation models in robotics: Applications, challenges, and the future

R Firoozi, J Tucker, S Tian, A Majumdar, J Sun… - arXiv preprint arXiv …, 2023 - arxiv.org
We survey applications of pretrained foundation models in robotics. Traditional deep
learning models in robotics are trained on small datasets tailored for specific tasks, which …

Label-efficient deep learning in medical image analysis: Challenges and future directions

C Jin, Z Guo, Y Lin, L Luo, H Chen - arXiv preprint arXiv:2303.12484, 2023 - arxiv.org
Deep learning has seen rapid growth in recent years and achieved state-of-the-art
performance in a wide range of applications. However, training models typically requires …

A survey of reasoning with foundation models

J Sun, C Zheng, E Xie, Z Liu, R Chu, J Qiu, J Xu… - arXiv preprint arXiv …, 2023 - arxiv.org
Reasoning, a crucial ability for complex problem-solving, plays a pivotal role in various real-
world settings such as negotiation, medical diagnosis, and criminal investigation. It serves …