[HTML][HTML] Surgical data science–from concepts toward clinical translation

L Maier-Hein, M Eisenmann, D Sarikaya, K März… - Medical image …, 2022 - Elsevier
Recent developments in data science in general and machine learning in particular have
transformed the way experts envision the future of surgery. Surgical Data Science (SDS) is a …

Artificial intelligence and automation in endoscopy and surgery

F Chadebecq, LB Lovat, D Stoyanov - … Reviews Gastroenterology & …, 2023 - nature.com
Modern endoscopy relies on digital technology, from high-resolution imaging sensors and
displays to electronics connecting configurable illumination and actuation systems for …

Rendezvous: Attention mechanisms for the recognition of surgical action triplets in endoscopic videos

CI Nwoye, T Yu, C Gonzalez, B Seeliger… - Medical Image …, 2022 - Elsevier
Out of all existing frameworks for surgical workflow analysis in endoscopic videos, action
triplet recognition stands out as the only one aiming to provide truly fine-grained and …

Cholectriplet2021: A benchmark challenge for surgical action triplet recognition

CI Nwoye, D Alapatt, T Yu, A Vardazaryan, F Xia… - Medical Image …, 2023 - Elsevier
Context-aware decision support in the operating room can foster surgical safety and
efficiency by leveraging real-time feedback from surgical workflow analysis. Most existing …

Towards holistic surgical scene understanding

N Valderrama, P Ruiz Puentes, I Hernández… - … conference on medical …, 2022 - Springer
Most benchmarks for studying surgical interventions focus on a specific challenge instead of
leveraging the intrinsic complementarity among different tasks. In this work, we present a …

CholecTriplet2022: Show me a tool and tell me the triplet—An endoscopic vision challenge for surgical action triplet detection

CI Nwoye, T Yu, S Sharma, A Murali, D Alapatt… - Medical Image …, 2023 - Elsevier
Formalizing surgical activities as triplets of the used instruments, actions performed, and
target anatomies is becoming a gold standard approach for surgical activity modeling. The …

Gmai-mmbench: A comprehensive multimodal evaluation benchmark towards general medical ai

P Chen, J Ye, G Wang, Y Li, Z Deng, W Li, T Li… - arXiv preprint arXiv …, 2024 - arxiv.org
Large Vision-Language Models (LVLMs) are capable of handling diverse data types such as
imaging, text, and physiological signals, and can be applied in various fields. In the medical …

Data splits and metrics for method benchmarking on surgical action triplet datasets

CI Nwoye, N Padoy - arXiv preprint arXiv:2204.05235, 2022 - arxiv.org
In addition to generating data and annotations, devising sensible data splitting strategies
and evaluation metrics is essential for the creation of a benchmark dataset. This practice …

Surgical action triplet detection by mixed supervised learning of instrument-tissue interactions

S Sharma, CI Nwoye, D Mutter, N Padoy - International Conference on …, 2023 - Springer
Surgical action triplets describe instrument-tissue interactions as< instrument, verb, target>
combinations, thereby supporting a detailed analysis of surgical scene activities and …

CPR-Coach: Recognizing composite error actions based on single-class training

S Wang, S Wang, D Yang, M Li… - Proceedings of the …, 2024 - openaccess.thecvf.com
Fine-grained medical action analysis plays a vital role in improving medical skill training
efficiency but it faces the problems of data and algorithm shortage. Cardiopulmonary …