Trans-svnet: hybrid embedding aggregation transformer for surgical workflow analysis

Y Jin, Y Long, X Gao, D Stoyanov, Q Dou… - International Journal of …, 2022 - Springer
Purpose Real-time surgical workflow analysis has been a key component for computer-
assisted intervention system to improve cognitive assistance. Most existing methods solely …

Deep learning for surgical workflow analysis: a survey of progresses, limitations, and trends

Y Li, Z Zhao, R Li, F Li - Artificial Intelligence Review, 2024 - Springer
Automatic surgical workflow analysis, which aims to recognize the ongoing surgical events
in videos, is fundamental for developing context-aware computer-assisted systems. This …

Learning multi-modal representations by watching hundreds of surgical video lectures

K Yuan, V Srivastav, T Yu, JL Lavanchy… - arXiv preprint arXiv …, 2023 - arxiv.org
Recent advancements in surgical computer vision have been driven by vision-only models,
which lack language semantics, relying on manually annotated videos to predict fixed object …

Large-scale surgical workflow segmentation for laparoscopic sacrocolpopexy

Y Zhang, S Bano, AS Page, J Deprest… - International Journal of …, 2022 - Springer
Purpose Laparoscopic sacrocolpopexy is the gold standard procedure for the management
of vaginal vault prolapse. Studying surgical skills and different approaches to this procedure …

Robotic scrub nurse to anticipate surgical instruments based on real-time laparoscopic video analysis

L Wagner, S Jourdan, L Mayer, C Müller… - Communications …, 2024 - nature.com
Background Machine learning and robotics technologies are increasingly being used in the
healthcare domain to improve the quality and efficiency of surgeries and to address …

Data-centric multi-task surgical phase estimation with sparse scene segmentation

R Sanchez-Matilla, M Robu… - International Journal of …, 2022 - Springer
Purpose Surgical workflow estimation techniques aim to divide a surgical video into
temporal segments based on predefined surgical actions or objectives, which can be of …

Anticipation for surgical workflow through instrument interaction and recognized signals

K Yuan, M Holden, S Gao, W Lee - Medical Image Analysis, 2022 - Elsevier
Surgical workflow anticipation is an essential task for computer-assisted intervention (CAI)
systems. It aims at predicting the future surgical phase and instrument occurrence, providing …

ST-ITEF: Spatio-Temporal Intraoperative Task Estimating Framework to recognize surgical phase and predict instrument path based on multi-object tracking in …

X Feng, X Zhang, X Shi, L Li, S Wang - Medical Image Analysis, 2024 - Elsevier
Computer-assisted cognition guidance for surgical robotics by computer vision is a potential
future outcome, which could facilitate the surgery for both operation accuracy and autonomy …

Procedure-Aware Surgical Video-language Pretraining with Hierarchical Knowledge Augmentation

K Yuan, V Srivastav, N Navab, N Padoy - arXiv preprint arXiv:2410.00263, 2024 - arxiv.org
Surgical video-language pretraining (VLP) faces unique challenges due to the knowledge
domain gap and the scarcity of multi-modal data. This study aims to bridge the gap by …

Know your sensors—a modality study for surgical action classification

L Bastian, T Czempiel, C Heiliger, K Karcz… - Computer Methods in …, 2023 - Taylor & Francis
The surgical operating room (OR) presents many opportunities for automation and
optimisation. Videos from various sources in the OR are becoming increasingly available …