A vision transformer for decoding surgeon activity from surgical videos

D Kiyasseh, R Ma, TF Haque, BJ Miles… - Nature biomedical …, 2023 - nature.com
The intraoperative activity of a surgeon has substantial impact on postoperative outcomes.
However, for most surgical procedures, the details of intraoperative surgical actions, which …

Computer vision in surgery

TM Ward, P Mascagni, Y Ban, G Rosman, N Padoy… - Surgery, 2021 - Elsevier
The fields of computer vision (CV) and artificial intelligence (AI) have undergone rapid
advancements in the past decade, many of which have been applied to the analysis of …

Impact of data on generalization of AI for surgical intelligence applications

O Bar, D Neimark, M Zohar, GD Hager, R Girshick… - Scientific reports, 2020 - nature.com
AI is becoming ubiquitous, revolutionizing many aspects of our lives. In surgery, it is still a
promise. AI has the potential to improve surgeon performance and impact patient care, from …

Automatic operating room surgical activity recognition for robot-assisted surgery

A Sharghi, H Haugerud, D Oh, O Mohareri - Medical Image Computing …, 2020 - Springer
Automatic recognition of surgical activities in the operating room (OR) is a key technology for
creating next generation intelligent surgical devices and workflow monitoring/support …

Evaluation of deep learning models for identifying surgical actions and measuring performance

S Khalid, M Goldenberg, T Grantcharov… - JAMA network …, 2020 - jamanetwork.com
Importance When evaluating surgeons in the operating room, experienced physicians must
rely on live or recorded video to assess the surgeon's technical performance, an approach …

Gesture recognition in robotic surgery with multimodal attention

B Van Amsterdam, I Funke, E Edwards… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Automatically recognising surgical gestures from surgical data is an important building block
of automated activity recognition and analytics, technical skill assessment, intra-operative …

VisionBlender: a tool to efficiently generate computer vision datasets for robotic surgery

J Cartucho, S Tukra, Y Li, D S. Elson… - Computer Methods in …, 2021 - Taylor & Francis
Surgical robots rely on robust and efficient computer vision algorithms to be able to
intervene in real-time. The main problem, however, is that the training or testing of such …

Towards automatic skill evaluation: Detection and segmentation of robot-assisted surgical motions

HC Lin, I Shafran, D Yuh, GD Hager - Computer aided surgery, 2006 - Taylor & Francis
This paper reports our progress in developing techniques for “parsing” raw motion data from
a simple surgical task into a labeled sequence of surgical gestures. The ability to …

Video-based surgical skill assessment using 3D convolutional neural networks

I Funke, ST Mees, J Weitz, S Speidel - International journal of computer …, 2019 - Springer
Purpose A profound education of novice surgeons is crucial to ensure that surgical
interventions are effective and safe. One important aspect is the teaching of technical skills …

Towards holistic surgical scene understanding

N Valderrama, P Ruiz Puentes, I Hernández… - … conference on medical …, 2022 - Springer
Most benchmarks for studying surgical interventions focus on a specific challenge instead of
leveraging the intrinsic complementarity among different tasks. In this work, we present a …