Metraipolis › archive › dc_1a57eb897635
EvoBench: An Evolving, Diagnostic Benchmark Framework for Environmental Modeling — arXiv:2610.35464
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.35464
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-27T07:58:37.755Z
- SHA-256 of the archived text
45a997653df8cac453aef4ebe54b3cc59b05f6e32744b5ce526580aab774c693- Stable URL of this page
https://metraipolis.com/documento/dc_1a57eb897635
How to cite
EvoBench: An Evolving, Diagnostic Benchmark Framework for Environmental Modeling — arXiv:2610.35464 — arXiv (en), https://arxiv.org/abs/2610.35464 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_1a57eb897635 (Metraipolis archive dc_1a57eb897635, sha256 45a997653df8cac453aef4ebe54b3cc59b05f6e32744b5ce526580aab774c693)
BibTeX
@misc{dc1a57eb897635,
title = {EvoBench: An Evolving, Diagnostic Benchmark Framework for Environmental Modeling — arXiv:2610.35464},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.35464},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_1a57eb897635; sha256 45a997653df8cac453aef4ebe54b3cc59b05f6e32744b5ce526580aab774c693},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.35464. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Machine learning models are now widely used to predict environmental variable dynamics in domains like hydrology, climate science, agriculture, and ecology. These models are usually compared on fixed benchmark datasets using a single average accuracy score. As models improve, their scores become very close when averaged over large regions and long time periods, so the benchmark can no longer tell them apart, and a single number hides \emph{where} and \emph{when} a model fails. Three failures are common across environmental domains: models get worse as the climate shifts (non-stationarity), models fail at unmonitored sites (spatial extrapolation), and models miss rare but important regimes such as floods and droughts. We present \textbf{EvoBench}, a benchmark framework that shows where a model fails, tracks failures over time, and evolves to focus on model capability gaps. We apply EvoBench to daily streamflow prediction as a case study (\textbf{CAMELS-Evolve}, about 9{,}000 U.S. basins, 1985--2024) and compare an operational physical model (NWM), a conceptual reference (HBV), and several data-driven models. No model wins on every testing scenarios (e.g., in terms of average accuracy, performance at low flows and unmonitored basins). Also we observe that all data-driven models under-predict floods. Additionally, we show that targeted fix based on the reported failures could mitigate weaknesses the benchmark identified in certain scenarios. EvoBench turns model evaluation from a saturated ranking into a moving map of model limitations.
Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2610.35464 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-27T07:55:30.756Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).