Metraipolis › archive › dc_fbed14a71206
Towards Calibrated Probabilistic Forecasts for Events of Interest via Outcome-Conditional Recalibration — arXiv:2610.10076
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.10076
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-08T12:37:19.307Z
- SHA-256 of the archived text
a39bf6e85cd7bd11a9665fbc4eb8f2683dbf775bdd423fb25673d41b74a9ada0- Stable URL of this page
https://metraipolis.com/documento/dc_fbed14a71206
How to cite
Towards Calibrated Probabilistic Forecasts for Events of Interest via Outcome-Conditional Recalibration — arXiv:2610.10076 — arXiv (en), https://arxiv.org/abs/2610.10076 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_fbed14a71206 (Metraipolis archive dc_fbed14a71206, sha256 a39bf6e85cd7bd11a9665fbc4eb8f2683dbf775bdd423fb25673d41b74a9ada0)
BibTeX
@misc{dcfbed14a71206,
title = {Towards Calibrated Probabilistic Forecasts for Events of Interest via Outcome-Conditional Recalibration — arXiv:2610.10076},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.10076},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_fbed14a71206; sha256 a39bf6e85cd7bd11a9665fbc4eb8f2683dbf775bdd423fb25673d41b74a9ada0},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.10076. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Calibration is an essential requirement for probabilistic predictions to be useful for decision making. While state-of-the-art prediction methods often yield miscalibrated predictive distributions, several post-hoc recalibration schemes have been proposed to generate calibrated predictions. However, popular recalibration schemes can conceal miscalibration in specific regions of the outcome space. Since particular outcomes, such as extreme events, often matter most for decision making, probabilistic predictions should be calibrated when evaluation is restricted to these outcomes. Hence, in this paper, we introduce outcome-conditional recalibration, a post-hoc method to recalibrate probabilistic predictions on user-defined regions of the outcome space. The method is simple, easy to implement, and can be applied to arbitrary predictive distributions. It works by applying the quantile recalibration approach of Kuleshov et al. (2018) to forecast conditional distributions, before rescaling these conditional distributions so that forecast event probabilities match empirical occurrence frequencies. This produces valid and continuous predictive distributions that are calibrated within each region of interest. Across regression benchmarks, we demonstrate that existing recalibration schemes do not necessarily yield calibrated predictions when interest is on particular outcomes, and that our approach improves outcome-conditional calibration relative to existing conditional and unconditional recalibration methods, while retaining competitive calibration overall. In an application to day-ahead electricity price forecasting, the approach substantially improves calibration when predicting negative prices, at negligible cost to forecast accuracy. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno). Categorie arXiv: Machine Learning (stat.ML) ; Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2610.10076 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-08T12:14:15.441Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).