Metraipolis › archive › dc_767cc7ce165e
FOCUS: Benchmarking Retinal Model Generalization from Foundation Vision Encoders to Multimodal LLMs — arXiv:2609.33158
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.33158
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T21:01:05.807Z
- SHA-256 of the archived text
dc6e04bad27bf0f15519e66c8db8318ae7ba8120bba7921479d1833e9e45b82c- Stable URL of this page
https://metraipolis.com/documento/dc_767cc7ce165e
How to cite
FOCUS: Benchmarking Retinal Model Generalization from Foundation Vision Encoders to Multimodal LLMs — arXiv:2609.33158 — arXiv (en), https://arxiv.org/abs/2609.33158 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_767cc7ce165e (Metraipolis archive dc_767cc7ce165e, sha256 dc6e04bad27bf0f15519e66c8db8318ae7ba8120bba7921479d1833e9e45b82c)
BibTeX
@misc{dc767cc7ce165e,
title = {FOCUS: Benchmarking Retinal Model Generalization from Foundation Vision Encoders to Multimodal LLMs — arXiv:2609.33158},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.33158},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_767cc7ce165e; sha256 dc6e04bad27bf0f15519e66c8db8318ae7ba8120bba7921479d1833e9e45b82c},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.33158. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Progress in AI-based retinal image analysis has advanced with foundation models, yet evaluating their reliability remains challenging. Performance reported on a single dataset does not capture how models behave under dataset shift, across clinical definitions, or for different patient subgroups. This limitation is particularly critical in medical imaging analysis, where robustness, calibration, and fairness are essential for safe deployment. We introduce FOCUS (Foundation Ophthalmic Cross-Dataset Understanding under Shift), a cross-dataset benchmark for evaluating retinal fundus models that considers vision-only encoder models (VM), vision-language dual-encoder models (VLM), and multimodal large language models (MLLM). FOCUS harmonizes binary diabetic retinopathy, referable diabetic retinopathy, and glaucomatous optic neuropathy tasks across ten public datasets spanning diverse geographies, acquisition conditions, and label protocols. The benchmark evaluates models through a unified analysis layer that measures ranking performance, calibration, subgroup disparities, and image-quality robustness. We present a large-scale evaluation covering 532 base configurations and 228 MLLM configurations adapted through supervised fine-tuning with low-rank adaptation (LoRA). Results show that no model family consistently dominates across tasks and datasets: general VM encoders achieve the strongest average ranking performance, medical MLLMs are competitive but variable, and dual encoder VLMs benefit substantially from lightweight adaptation. Fine-tuning improves in-domain performance but exhibits heterogeneous transfer to external datasets, particularly in calibration. These findings demonstrate that retinal model evaluation is inherently multidimensional. FOCUS provides a practical framework and public benchmark to assess generalization, reliability, and robustness beyond single-dataset leaderboards Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.AI). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2609.33158 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T20:29:02.562Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).