notesum.ai
Published at November 17Multi-Modal Self-Supervised Learning for Surgical Feedback Effectiveness Assessment
cs.AI
cs.CV
Released Date: November 17, 2024
Authors: Arushi Gupta, Rafal Kocielnik, Jiayun Wang, Firdavs Nasriddinov1, Cherine Yang2, Elyssa Wong3, Anima Anandkumar1, Andrew Hung
Aff.: 1California Institute of Technology, USA; 2Cedars-Sinai Medical Center, USA; 3University of Southern California, USA
| Method | AUROC | Precision | Recall |
|---|---|---|---|
| Text | 0.66±0.004 | 0.62±0.02 | 0.62±0.13 |
| Text + VideoMAE | 0.68 | 0.63±0.01 | 0.59±0.10 |
| Text + VideoMAE (Task-relevant) | 0.70 | 0.65±0.03 | 0.56±0.15 |
| Text + VideoMAE (Domain-relevant) | 0.70±0.02 | 0.63±0.03 | 0.66±0.09 |