Metraipolis › archive › dc_63d8693e2f89

SurgStream: A Workflow-Anchored Proactive Streaming Framework and Benchmark for Real-Time Surgical Video Understanding — arXiv:2611.01982

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.01982
License (as archived)
CC0-1.0
Archived
2026-11-03T10:57:37.619Z
SHA-256 of the archived text
c36a244a450c8b250059755479c7599fef3fc0f8b76eb21d4a51d5ee453dddd5
Stable URL of this page
https://metraipolis.com/documento/dc_63d8693e2f89

How to cite

SurgStream: A Workflow-Anchored Proactive Streaming Framework and Benchmark for Real-Time Surgical Video Understanding — arXiv:2611.01982 — arXiv (en), https://arxiv.org/abs/2611.01982 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_63d8693e2f89 (Metraipolis archive dc_63d8693e2f89, sha256 c36a244a450c8b250059755479c7599fef3fc0f8b76eb21d4a51d5ee453dddd5)
BibTeX
@misc{dc63d8693e2f89,
  title = {SurgStream: A Workflow-Anchored Proactive Streaming Framework and Benchmark for Real-Time Surgical Video Understanding — arXiv:2611.01982},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.01982},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_63d8693e2f89; sha256 c36a244a450c8b250059755479c7599fef3fc0f8b76eb21d4a51d5ee453dddd5},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.01982. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Surgical video understanding is essential for intraoperative assistance such as workflow monitoring, instrument preparation and procedural documentation. Delivering such assistance in real time requires a model to jointly perceive the ongoing scene, remember past surgical events, and respond before clinically relevant moments pass. Existing approaches provide limited support for jointly retaining procedural evidence and deciding when to respond in streaming surgical video. In this work, we propose SurgStream, a workflow-anchored proactive streaming framework for real-time surgical video understanding. We first introduce Workflow-Anchored Memory (WAM) to record structured instrument-action-target observations and fold them into phase-level summaries, providing compact and queryable surgical memory. Deadline-aware Transition Learning (DTL) is then devised to supervise response states within clinical windows, enabling timely responses before procedural deadlines. We further introduce SurgStream-Bench, comprising 11.7K streaming interactions across various tasks covering real-time perception, backward memory queries, forward proactive QA, proactive alerts and caption memory. Experiments on SurgStream-Bench show gains over state-of-the-art methods, especially in memory and forward proactive QA. The source code will be available.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2611.01982 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T10:49:38.612Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).