Metraipolis › archive › dc_3e8bb3a2f137

MIRROR: Multimodal Intelligent Radiology Reasoning and Observation Reporter — arXiv:2608.16709

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.16709
License (as archived)
CC0-1.0
Archived
2026-10-18T18:07:30.858Z
SHA-256 of the archived text
07d5ce323e718ab26495115ec554e1bbe15eccce17d0bab0a35db9fbe2b29cf8
Stable URL of this page
https://metraipolis.com/documento/dc_3e8bb3a2f137

How to cite

MIRROR: Multimodal Intelligent Radiology Reasoning and Observation Reporter — arXiv:2608.16709 — arXiv (en), https://arxiv.org/abs/2608.16709 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_3e8bb3a2f137 (Metraipolis archive dc_3e8bb3a2f137, sha256 07d5ce323e718ab26495115ec554e1bbe15eccce17d0bab0a35db9fbe2b29cf8)
BibTeX
@misc{dc3e8bb3a2f137,
  title = {MIRROR: Multimodal Intelligent Radiology Reasoning and Observation Reporter — arXiv:2608.16709},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.16709},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_3e8bb3a2f137; sha256 07d5ce323e718ab26495115ec554e1bbe15eccce17d0bab0a35db9fbe2b29cf8},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.16709. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

A radiologist reading a model's output faces two problems. The model returns a number and no reason, and any system that turns that number into readable prose can quietly add claims the model never made. MIRROR is a research prototype built to separate those failures. It chains a multi-label classifier, a Grad-CAM localizer that turns each positive finding into a named anatomical region, and a report writer that receives the labels, probabilities, and regions but never the image. Because the language layer cannot see pixels, it cannot assert a finding the classifier did not make. We are precise about what that buys: a MIRROR report's findings are auditable against the probability vector, while the sentences framing them are ordinary generated text, and we show one stating a cardiothoracic ratio the system never measured. One registry holds the taxonomy, anatomy, and phrasing for chest X-ray, brain MRI, and head CT, so adding a modality is a data change; all three are routed and tested, one is trained. On ChestMNIST that classifier reaches macro AUROC 0.729 and ranks better than chance on all 14 labels, at 1.6 to 6.8 times the precision a random ranker would get. Yet at the default 0.5 threshold it emits no positive prediction at all for 11 of them, and its excellent-looking Brier score of 0.045 sits beside the 0.047 earned by a predictor that ignores the image. The discrimination is real; the decisions are not. Under the class imbalance normal in radiology, aggregate metrics flatter models that do nothing, and should be reported against that floor.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-18 in cs.AI).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI); Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2608.16709 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T16:29:14.143Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).