A vision transformer for decoding surgeon activity from surgical videos

D Kiyasseh, R Ma, TF Haque, BJ Miles… - Nature biomedical …, 2023 - nature.com
The intraoperative activity of a surgeon has substantial impact on postoperative outcomes.
However, for most surgical procedures, the details of intraoperative surgical actions, which …

Artificial intelligence in surgery

C Varghese, EM Harrison, G O'Grady, EJ Topol - Nature Medicine, 2024 - nature.com
Artificial intelligence (AI) is rapidly emerging in healthcare, yet applications in surgery
remain relatively nascent. Here we review the integration of AI in the field of surgery …

Capabilities of gemini models in medicine

K Saab, T Tu, WH Weng, R Tanno, D Stutz… - arXiv preprint arXiv …, 2024 - arxiv.org
Excellence in a wide variety of medical applications poses considerable challenges for AI,
requiring advanced reasoning, access to up-to-date medical knowledge and understanding …

Foundation model for endoscopy video analysis via large-scale self-supervised pre-train

Z Wang, C Liu, S Zhang, Q Dou - International Conference on Medical …, 2023 - Springer
Foundation models have exhibited remarkable success in various applications, such as
disease diagnosis and text report generation. To date, a foundation model for endoscopic …

Towards holistic surgical scene understanding

N Valderrama, P Ruiz Puentes, I Hernández… - … conference on medical …, 2022 - Springer
Most benchmarks for studying surgical interventions focus on a specific challenge instead of
leveraging the intrinsic complementarity among different tasks. In this work, we present a …

Using AI and computer vision to analyze technical proficiency in robotic surgery

JH Yang, ED Goodman, AJ Dawes, JV Gahagan… - Surgical …, 2023 - Springer
Background Intraoperative skills assessment is time-consuming and subjective; an efficient
and objective computer vision-based approach for feedback is desired. In this work, we aim …

A multi-task convolutional neural network for semantic segmentation and event detection in laparoscopic surgery

G Marullo, L Tanzi, L Ulrich, F Porpiglia… - Journal of Personalized …, 2023 - mdpi.com
The current study presents a multi-task end-to-end deep learning model for real-time blood
accumulation detection and tools semantic segmentation from a laparoscopic surgery video …

Retrieval of surgical phase transitions using reinforcement learning

Y Zhang, S Bano, AS Page, J Deprest… - … conference on medical …, 2022 - Springer
In minimally invasive surgery, surgical workflow segmentation from video analysis is a well
studied topic. The conventional approach defines it as a multi-class classification problem …

Surgical tool detection in open surgery videos

R Fujii, R Hachiuma, H Kajita, H Saito - Applied Sciences, 2022 - mdpi.com
Detecting surgical tools is an essential task for analyzing and evaluating surgical videos.
However, most studies focus on minimally invasive surgery (MIS) and cataract surgery …

POV-Surgery: A Dataset for Egocentric Hand and Tool Pose Estimation During Surgical Activities

R Wang, S Ktistakis, S Zhang, M Meboldt… - … Conference on Medical …, 2023 - Springer
The surgical usage of Mixed Reality (MR) has received growing attention in areas such as
surgical navigation systems, skill assessment, and robot-assisted surgeries. For such …