Metraipolis › archive › dc_52c6f8a47cd0
Data Leakage Inflates Generalizability of Power Outage Prediction Models — arXiv:2608.24665
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.24665
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-18T06:36:20.410Z
- SHA-256 of the archived text
48b88c040d07125a76bcef38c0806defb64962098d7cf0f40688a966be66af5a- Stable URL of this page
https://metraipolis.com/documento/dc_52c6f8a47cd0
How to cite
Data Leakage Inflates Generalizability of Power Outage Prediction Models — arXiv:2608.24665 — arXiv (en), https://arxiv.org/abs/2608.24665 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_52c6f8a47cd0 (Metraipolis archive dc_52c6f8a47cd0, sha256 48b88c040d07125a76bcef38c0806defb64962098d7cf0f40688a966be66af5a)
BibTeX
@misc{dc52c6f8a47cd0,
title = {Data Leakage Inflates Generalizability of Power Outage Prediction Models — arXiv:2608.24665},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.24665},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_52c6f8a47cd0; sha256 48b88c040d07125a76bcef38c0806defb64962098d7cf0f40688a966be66af5a},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.24665. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Power outage prediction models are increasingly used in assessments of climate-driven infrastructure risk, yet current evaluation practices obscure whether these models generalize to the novel conditions such applications require. We identify three common methodological choices in power outage prediction models that influence their ability to generalize across spatial, temporal, and event-based settings. We compare the predictive performance impacts of different methodological decisions using publicly available data for the U.S. East Coast from 2018 to 2023 and feature sets derived from weather reanalysis and land-cover data, and embeddings from a GeoAI foundation model (Prithvi WxC). Specifically, we assess model performance under multiple test selection strategies, including unfiltered random splits, leave-one-state-out, and leave-one-event-out designs, which increasingly approximate real-world deployment conditions. While random train-test splits yield strong performance, we show that these results are inflated by spatial and temporal autocorrelation. Under spatial and temporal holdout experiments, predictive accuracy degrades substantially, with models often failing to outperform a simple null baseline. Incorporating GeoAI foundation model embeddings yields limited and inconsistent improvements, primarily for spatial generalization, and does not resolve poor event-level transferability. These findings suggest that, given current data availability and evaluation practices, publicly trained outage prediction models offer limited and uncertain operational value. Progress will likely require improved data coverage, more realistic evaluation protocols, and a shift in focus from marginal modeling advances toward addressing structural data constraints. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-26 in cs.LG). Categorie arXiv: Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2608.24665 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-18T06:28:52.266Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-08-26?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).