Metraipolis › archive › dc_ac6eb16903fa

Co-Annotator: Expert-Distilled ViT and VLM for Visual and Documentation Guidance in Age-Related Macular Degeneration — arXiv:2608.30352

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.30352
License (as archived)
CC0-1.0
Archived
2026-10-17T07:44:37.155Z
SHA-256 of the archived text
356b38996d30a7a40fce8205b5a16b27cab9011f357a225f76a18ff1941cc2ac
Stable URL of this page
https://metraipolis.com/documento/dc_ac6eb16903fa

How to cite

Co-Annotator: Expert-Distilled ViT and VLM for Visual and Documentation Guidance in Age-Related Macular Degeneration — arXiv:2608.30352 — arXiv (en), https://arxiv.org/abs/2608.30352 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ac6eb16903fa (Metraipolis archive dc_ac6eb16903fa, sha256 356b38996d30a7a40fce8205b5a16b27cab9011f357a225f76a18ff1941cc2ac)
BibTeX
@misc{dcac6eb16903fa,
  title = {Co-Annotator: Expert-Distilled ViT and VLM for Visual and Documentation Guidance in Age-Related Macular Degeneration — arXiv:2608.30352},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.30352},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ac6eb16903fa; sha256 356b38996d30a7a40fce8205b5a16b27cab9011f357a225f76a18ff1941cc2ac},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.30352. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Clinical AI often optimizes predictive performance without engaging how clinicians decide where to look and what to write. We present Co-Annotator, which distills expert gaze and dictation into two guidance components: a gaze-aligned Vision Transformer producing fixation-aligned areas of interest (AOIs), and an ontology-bounded vision-language model (VLM) that pre-fills editable biomarker summaries for retinal optical coherence tomography (OCT). We first collect expert gaze and dictations (US1) to train the models, significantly improving diagnostic accuracy and biomarker generation. We then deploy the system with ophthalmology residents: a controlled resident study (US2) confirmed each modality is safe and independently beneficial, with AOI guidance producing lasting perceptual efficiency gains through post-guidance carryover and VLM guidance more than doubling biomarker documentation breadth. In a combined deployment across two academic institutions (US3), providing both modalities simultaneously produced efficiency gains that substantially exceeded either modality alone: correct diagnoses per minute increased by 40% and comment editing time fell by 67%, without compromising diagnostic accuracy. Notably, neither modality improved efficiency during guidance in US2, which makes the in-guidance efficiency gain under combined guidance in US3 the more striking result. Expert-distilled multimodal guidance can remove two distinct clinical workflow bottlenecks at once (visual search overhead and documentation burden) without compromising the diagnostic accuracy clinicians already achieve.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-01 in cs.AI).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Human-Computer Interaction (cs.HC).
Pagina del lavoro: https://arxiv.org/abs/2608.30352 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T07:28:26.597Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).