Metraipolis › archive › dc_cdb47e393dc6
CAMEL: Cross-Architecture Masked Embedding Learning for Ultra-Lightweight Retinal Foundation Models — arXiv:2610.40954
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.40954
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T07:22:19.788Z
- SHA-256 of the archived text
b21bb71ea979bf5fa341e41d4ec48e3ee2c2cba2c9c9b7547353e7ceab99673c- Stable URL of this page
https://metraipolis.com/documento/dc_cdb47e393dc6
How to cite
CAMEL: Cross-Architecture Masked Embedding Learning for Ultra-Lightweight Retinal Foundation Models — arXiv:2610.40954 — arXiv (en), https://arxiv.org/abs/2610.40954 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_cdb47e393dc6 (Metraipolis archive dc_cdb47e393dc6, sha256 b21bb71ea979bf5fa341e41d4ec48e3ee2c2cba2c9c9b7547353e7ceab99673c)
BibTeX
@misc{dccdb47e393dc6,
title = {CAMEL: Cross-Architecture Masked Embedding Learning for Ultra-Lightweight Retinal Foundation Models — arXiv:2610.40954},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.40954},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_cdb47e393dc6; sha256 b21bb71ea979bf5fa341e41d4ec48e3ee2c2cba2c9c9b7547353e7ceab99673c},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.40954. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Recent progress in deep learning has substantially advanced automated grading of ophthalmologic pathologies, supported by large annotated datasets and improved representation learning. However, a significant gap remains between state-of-the-art performance and clinical scalability. In particular, foundation models have reshaped image-based medical screening and diagnosis. These large-scale architectures trained on extensive datasets learn rich, generalizable feature representations that can be adapted to a wide range of downstream tasks. In ophthalmology, RETFound, one of the most relevant foundation models for retinal images, performs strongly across classification, segmentation, and risk prediction tasks. Despite their effectiveness, foundation models are often computationally prohibitive, hindering their deployment in real-world clinical environments where hardware constraints and latency are critical. To bridge this gap, we introduce CAMEL (Cross-Architecture Masked Embedding Learning), a novel cross-architecture distillation framework that uses an asymmetric masking strategy during embedding learning to effectively transfer knowledge from massive teacher foundation models to compact, lightweight student models. Our experimental evaluation across four datasets shows that CAMEL preserves accuracy while drastically reducing computational complexity, enabling lightweight yet highly accurate models suitable for resource-limited clinical settings. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Machine Learning (cs.LG) ; Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV). Pagina del lavoro: https://arxiv.org/abs/2610.40954 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T07:19:48.882Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).