Metraipolis › archive › dc_3fed51af883c
Performance metrics in machine learning: a scenario-based guide from the confusion matrix to calibration, regression and uncertainty — arXiv:2611.08048
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.08048
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-06T14:50:50.859Z
- SHA-256 of the archived text
b1a1432ab841a7d2c1ee5ae0df4c2f2c9cd79efe49914bc9f290b2372c60e4b5- Stable URL of this page
https://metraipolis.com/documento/dc_3fed51af883c
How to cite
Performance metrics in machine learning: a scenario-based guide from the confusion matrix to calibration, regression and uncertainty — arXiv:2611.08048 — arXiv (en), https://arxiv.org/abs/2611.08048 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_3fed51af883c (Metraipolis archive dc_3fed51af883c, sha256 b1a1432ab841a7d2c1ee5ae0df4c2f2c9cd79efe49914bc9f290b2372c60e4b5)
BibTeX
@misc{dc3fed51af883c,
title = {Performance metrics in machine learning: a scenario-based guide from the confusion matrix to calibration, regression and uncertainty — arXiv:2611.08048},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.08048},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_3fed51af883c; sha256 b1a1432ab841a7d2c1ee5ae0df4c2f2c9cd79efe49914bc9f290b2372c60e4b5},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.08048. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Performance metrics can yield different conclusions from the same predictions. This methodological tutorial explains the effects of class prevalence, decision thresholds, aggregation rules and software conventions through controlled scenarios. Twenty-two confusion-matrix metrics are organized in a prevalence-coded map. Fifteen scenarios cover binary and multi-class classification, score discrimination, probability calibration, regression, uncertainty and consistency checks. Inputs are fixed in released files, and one factor is varied in each scenario. All 205 verification checks passed; 202 were independent and 3 were internal. An always-negative rule achieved an accuracy of 0.990 at a prevalence of 0.010, with balanced accuracy of 0.500. At fixed sensitivity and specificity, precision fell from 0.889 to 0.008 as prevalence fell from 0.5 to 0.001. Three probability variants shared a ROC-AUC of 0.825 but had calibration slopes of 2.08, 1.04 and 0.52. With 10 participants, participant-majority accuracy of 0.700 had a 95% interval of 0.348-0.933. Fold-averaged scores were falsely flagged as inconsistent under an inappropriate pooled-test-set model. A goal-based metric table and a reporting checklist are provided. The scenarios illustrate mechanisms and do not estimate their frequency in published studies. A literature audit and a real-data demonstration are specified as future protocols and were not executed. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno). Categorie arXiv: Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2611.08048 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-06T14:21:42.641Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).