Metraipolis › archive › dc_01e9b82cb29d

SurgStream: A Workflow-Anchored Proactive Streaming Framework and Benchmark for Real-Time Surgical Video Understanding — arXiv:2611.01982

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.01982
License (as archived)
CC0-1.0
Archived
2026-11-03T10:48:04.067Z
SHA-256 of the archived text
5430860f274cb079d2750b838c8722f171a665c462edcf845526b6cd1f4d398d
Stable URL of this page
https://metraipolis.com/documento/dc_01e9b82cb29d

How to cite

SurgStream: A Workflow-Anchored Proactive Streaming Framework and Benchmark for Real-Time Surgical Video Understanding — arXiv:2611.01982 — arXiv (en), https://arxiv.org/abs/2611.01982 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_01e9b82cb29d (Metraipolis archive dc_01e9b82cb29d, sha256 5430860f274cb079d2750b838c8722f171a665c462edcf845526b6cd1f4d398d)
BibTeX
@misc{dc01e9b82cb29d,
  title = {SurgStream: A Workflow-Anchored Proactive Streaming Framework and Benchmark for Real-Time Surgical Video Understanding — arXiv:2611.01982},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.01982},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_01e9b82cb29d; sha256 5430860f274cb079d2750b838c8722f171a665c462edcf845526b6cd1f4d398d},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.01982. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Surgical video understanding is essential for intraoperative assistance such as workflow monitoring, instrument preparation and procedural documentation. Delivering such assistance in real time requires a model to jointly perceive the ongoing scene, remember past surgical events, and respond before clinically relevant moments pass. Existing approaches provide limited support for jointly retaining procedural evidence and deciding when to respond in streaming surgical video. In this work, we propose SurgStream, a workflow-anchored proactive streaming framework for real-time surgical video understanding. We first introduce Workflow-Anchored Memory (WAM) to record structured instrument-action-target observations and fold them into phase-level summaries, providing compact and queryable surgical memory. Deadline-aware Transition Learning (DTL) is then devised to supervise response states within clinical windows, enabling timely responses before procedural deadlines. We further introduce SurgStream-Bench, comprising 11.7K streaming interactions across various tasks covering real-time perception, backward memory queries, forward proactive QA, proactive alerts and caption memory. Experiments on SurgStream-Bench show gains over state-of-the-art methods, especially in memory and forward proactive QA. The source code will be available.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2611.01982 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T10:39:50.533Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).