Artificial intelligence and automation in endoscopy and surgery

F Chadebecq, LB Lovat, D Stoyanov - … Reviews Gastroenterology & …, 2023 - nature.com
Modern endoscopy relies on digital technology, from high-resolution imaging sensors and
displays to electronics connecting configurable illumination and actuation systems for …

A vision transformer for decoding surgeon activity from surgical videos

D Kiyasseh, R Ma, TF Haque, BJ Miles… - Nature biomedical …, 2023 - nature.com
The intraoperative activity of a surgeon has substantial impact on postoperative outcomes.
However, for most surgical procedures, the details of intraoperative surgical actions, which …

CholecTriplet2022: Show me a tool and tell me the triplet—An endoscopic vision challenge for surgical action triplet detection

CI Nwoye, T Yu, S Sharma, A Murali, D Alapatt… - Medical Image …, 2023 - Elsevier
Formalizing surgical activities as triplets of the used instruments, actions performed, and
target anatomies is becoming a gold standard approach for surgical activity modeling. The …

Dissecting self-supervised learning methods for surgical computer vision

S Ramesh, V Srivastav, D Alapatt, T Yu, A Murali… - Medical Image …, 2023 - Elsevier
The field of surgical computer vision has undergone considerable breakthroughs in recent
years with the rising popularity of deep neural network-based methods. However, standard …

Biomedical image analysis competitions: The state of current participation practice

M Eisenmann, A Reinke, V Weru, MD Tizabi… - arXiv preprint arXiv …, 2022 - arxiv.org
The number of international benchmarking competitions is steadily increasing in various
fields of machine learning (ML) research and practice. So far, however, little is known about …

Surgical tool datasets for machine learning research: a survey

M Rodrigues, M Mayo, P Patros - International Journal of Computer Vision, 2022 - Springer
This paper is a comprehensive survey of datasets for surgical tool detection and related
surgical data science and machine learning techniques and algorithms. The survey offers a …

Holistic evaluation of gpt-4v for biomedical imaging

Z Liu, H Jiang, T Zhong, Z Wu, C Ma, Y Li, X Yu… - arXiv preprint arXiv …, 2023 - arxiv.org
In this paper, we present a large-scale evaluation probing GPT-4V's capabilities and
limitations for biomedical image analysis. GPT-4V represents a breakthrough in artificial …

Deep learning for surgical workflow analysis: a survey of progresses, limitations, and trends

Y Li, Z Zhao, R Li, F Li - Artificial Intelligence Review, 2024 - Springer
Automatic surgical workflow analysis, which aims to recognize the ongoing surgical events
in videos, is fundamental for developing context-aware computer-assisted systems. This …

Data splits and metrics for method benchmarking on surgical action triplet datasets

CI Nwoye, N Padoy - arXiv preprint arXiv:2204.05235, 2022 - arxiv.org
In addition to generating data and annotations, devising sensible data splitting strategies
and evaluation metrics is essential for the creation of a benchmark dataset. This practice …

Surgical action triplet detection by mixed supervised learning of instrument-tissue interactions

S Sharma, CI Nwoye, D Mutter, N Padoy - International Conference on …, 2023 - Springer
Surgical action triplets describe instrument-tissue interactions as< instrument, verb, target>
combinations, thereby supporting a detailed analysis of surgical scene activities and …