Metraipolis › archive › dc_adae48eeb636
Time Series Forecasting Benchmarks Need Scenario-Grounded Stress Testing — arXiv:2610.02608
- Source
- arXiv
- Original
- https://arxiv.org/abs/2610.02608
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-05T22:49:05.642Z
- SHA-256 of the archived text
6e8330e878de7fe6f07a5181f4dac815ba015c8a0d6d7137b93d89d1e30dbeb2- Stable URL of this page
https://metraipolis.com/documento/dc_adae48eeb636
How to cite
Time Series Forecasting Benchmarks Need Scenario-Grounded Stress Testing — arXiv:2610.02608 — arXiv, https://arxiv.org/abs/2610.02608 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_adae48eeb636 (Metraipolis archive dc_adae48eeb636, sha256 6e8330e878de7fe6f07a5181f4dac815ba015c8a0d6d7137b93d89d1e30dbeb2)
BibTeX
@misc{dcadae48eeb636,
title = {Time Series Forecasting Benchmarks Need Scenario-Grounded Stress Testing — arXiv:2610.02608},
howpublished = {arXiv},
url = {https://arxiv.org/abs/2610.02608},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_adae48eeb636; sha256 6e8330e878de7fe6f07a5181f4dac815ba015c8a0d6d7137b93d89d1e30dbeb2},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv, https://arxiv.org/abs/2610.02608. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Time series forecasting (TSF) increasingly drives decisions in transportation, energy, finance, healthcare, and infrastructure, yet current evaluation remains overly narrow: standard benchmarks reward low held-out error, while robustness studies typically reduce failure to Gaussian noise, random masking, or bounded adversarial perturbations. This obscures the real failure modes of deployed forecasting systems. Input-side anomalies are not merely noisier inputs: they often reflect structured events that alter temporal dynamics, break cross-variable dependencies, induce regime shifts, or propagate from faulty sensors to downstream decisions. These semantic, causal, and system-level failures cannot be faithfully captured by i.i.d. perturbations alone. The rise of TSF foundation models makes this evaluation gap more urgent, as unauditable pretraining corpora make held-out generalization increasingly unreliable. We therefore advocate scenario-grounded stress testing. Each test instance should include historical inputs and future targets, together with a semantic scenario, an explicit failure operator, and a measurable difficulty level. This shift makes evaluation interpretable, attributable, and deployment-relevant and friendly, enabling the community to ask not only which model is accurate, but under what conditions it fails and why. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2610.02608 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-05T22:45:55.607Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).