Metraipolis › archive › dc_abafc571ff5c
Contrastive Adapter Training and Consensus Knowledge Distillation for Multi-Source-Free Domain Adaptation in Skin Cancer Diagnosis — arXiv:2611.03528
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.03528
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T10:38:16.758Z
- SHA-256 of the archived text
65eb4ede87baf816be6ea52f97da39b5cc4c2146d6a300e7924cd143e4da0ca2- Stable URL of this page
https://metraipolis.com/documento/dc_abafc571ff5c
How to cite
Contrastive Adapter Training and Consensus Knowledge Distillation for Multi-Source-Free Domain Adaptation in Skin Cancer Diagnosis — arXiv:2611.03528 — arXiv (en), https://arxiv.org/abs/2611.03528 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_abafc571ff5c (Metraipolis archive dc_abafc571ff5c, sha256 65eb4ede87baf816be6ea52f97da39b5cc4c2146d6a300e7924cd143e4da0ca2)
BibTeX
@misc{dcabafc571ff5c,
title = {Contrastive Adapter Training and Consensus Knowledge Distillation for Multi-Source-Free Domain Adaptation in Skin Cancer Diagnosis — arXiv:2611.03528},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.03528},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_abafc571ff5c; sha256 65eb4ede87baf816be6ea52f97da39b5cc4c2146d6a300e7924cd143e4da0ca2},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.03528. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Skin cancer diagnosis, particularly differentiating melanoma from benign nevi, is challenging due to the visual similarity between lesions. Although convolutional neural networks (CNNs) and vision transformers (ViTs) have shown promising performance, their effectiveness often deteriorates on data from heterogeneous clinical sources. Conventional domain adaptation methods address domain shift but require access to source data during adaptation, which is often infeasible due to privacy regulations. Multi-source-free unsupervised domain adaptation (MSFDA) addresses this limitation by leveraging multiple labeled source domains to generalize to an unlabeled target domain without requiring access to source data. However, existing MSFDA methods rely on full backbone fine-tuning, leading to catastrophic forgetting and overfitting on small clinical datasets, and address domain shift at the aggregation stage without establishing a shared domain-invariant feature space. Furthermore, their reliance on hard pseudo-labels or confidence-weighted aggregation introduces noisy supervision signals under domain shift. To address these limitations, we propose CAT-CKD, consisting of two components: (1) contrastive adapter training (CAT), which trains lightweight ConvPass adapters within a frozen ViT backbone using supervised contrastive learning (SCL) to establish a shared domain-invariant feature space before source-specific model training, and (2) consensus knowledge distillation (CKD), which aggregates logits from multiple source models into a consensus supervisory signal and adapts a student model on unlabeled target data using KL divergence. Experiments on five publicly available skin lesion datasets show that CAT-CKD achieves an average AUROC of 86.1%, outperforming existing MSFDA methods while requiring only 4.3M trainable parameters. The code is available at this https URL . Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2611.03528 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T10:29:48.952Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).