Metraipolis › archive › dc_9e60d575bc2f
Align Before You Combine: Reference Space Calibration for Supervision Without Ground Truth — arXiv:2610.09525
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.09525
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-08T11:11:09.532Z
- SHA-256 of the archived text
f42ce9301871cac29bc356ed1e7153c3465398e1e5331aa4ee6783937bb97901- Stable URL of this page
https://metraipolis.com/documento/dc_9e60d575bc2f
How to cite
Align Before You Combine: Reference Space Calibration for Supervision Without Ground Truth — arXiv:2610.09525 — arXiv (en), https://arxiv.org/abs/2610.09525 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_9e60d575bc2f (Metraipolis archive dc_9e60d575bc2f, sha256 f42ce9301871cac29bc356ed1e7153c3465398e1e5331aa4ee6783937bb97901)
BibTeX
@misc{dc9e60d575bc2f,
title = {Align Before You Combine: Reference Space Calibration for Supervision Without Ground Truth — arXiv:2610.09525},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.09525},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_9e60d575bc2f; sha256 f42ce9301871cac29bc356ed1e7153c3465398e1e5331aa4ee6783937bb97901},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.09525. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
We introduce a calibration-first framework that produces supervision scores without access to ground-truth labels or a shared annotation space. Our framework aligns subset-specific scorers using a synthetic ordinal reference space before fusion. This reference space is constructed from ordered calibration features that represent the latent concept, providing a common scale on which otherwise incomparable scorer outputs can be aligned. Because our calibration procedure uses the reference space rather than training samples, it is independent of the training set's empirical distribution. Across three benchmark datasets, our framework consistently outperforms uncalibrated averaging and achieves higher primary-metric point estimates on the evaluation metrics than the best individual scorer. Performance relative to sample-dependent baselines varies by domain, with absolute differences below 0.02 on Ames Housing and below 0.01 on Breast Cancer Wisconsin and Wine Quality. After Bonferroni correction, differences remain significant for all three comparisons on Ames Housing and one on Breast Cancer Wisconsin. Additionally, we show that using fewer calibration levels per feature can closely approximate higher-resolution results at substantially lower computational cost. Together, these results support our framework as a viable approach to construct supervision scores when neither ground-truth labels nor a shared annotation space is available. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Machine Learning (cs.LG) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2610.09525 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-08T10:14:06.099Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).