Metraipolis › archive › dc_d15754f7bd44

The Impossible Trinity of Time-Series Validation: A Conservation Law among Training Sufficiency, Test Coverage, and Temporal Causality — arXiv:2609.29530

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.29530
License (as archived)
CC0-1.0
Archived
2026-10-08T05:26:04.707Z
SHA-256 of the archived text
7857767aa7a5dfd553487ea6e7a34f521cdbbc2dd0f9bfea15136bfc8036c082
Stable URL of this page
https://metraipolis.com/documento/dc_d15754f7bd44

How to cite

The Impossible Trinity of Time-Series Validation: A Conservation Law among Training Sufficiency, Test Coverage, and Temporal Causality — arXiv:2609.29530 — arXiv (en), https://arxiv.org/abs/2609.29530 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d15754f7bd44 (Metraipolis archive dc_d15754f7bd44, sha256 7857767aa7a5dfd553487ea6e7a34f521cdbbc2dd0f9bfea15136bfc8036c082)
BibTeX
@misc{dcd15754f7bd44,
  title = {The Impossible Trinity of Time-Series Validation: A Conservation Law among Training Sufficiency, Test Coverage, and Temporal Causality — arXiv:2609.29530},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.29530},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d15754f7bd44; sha256 7857767aa7a5dfd553487ea6e7a34f521cdbbc2dd0f9bfea15136bfc8036c082},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.29530. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Validating a model on a time series asks for three things at once: each training run should use most of the sample (sufficiency), the test sets should together cover most of the sample (coverage), and training data should come before test data (causality). We prove that the three cannot be had together and price each one. Let $\alpha$ be the smallest training fraction over folds, $\beta$ the fraction of the sample covered by tests, $\Lambda$ the fraction of the sample used as training data from the future of a test point, and $\delta$ the distance from a test point to the nearest training point in its future. Every scheme on a sample of length $T$ satisfies $\alpha+\beta \le 1+\Lambda$ and $\alpha+\min\{\beta,\delta/T\} \le 1$, and under $\beta$-mixing the leakage bias at a test point is at most $2M\beta_{\mathrm{mix}}(\delta)$. In words: going beyond the causal frontier $\alpha+\beta=1$ requires training on the future; that future data must sit within $(1-\alpha)T$ of a test point; and its harm depends on its distance, not its amount. Hence expanding walk-forward is exactly the Pareto frontier of causal validation, $k$-fold cross-validation buys the most future data, and purged $k$-fold with an embargo pays in distance instead, which is cheap when the process forgets quickly but cannot repair the part of causality demanded by non-stationarity. On pure noise, shuffled 5-fold reports an information coefficient of $+0.32$, while contiguous 5-fold, using the same amount of future data, reports $+0.004$.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-25 in cs.LG).
Categorie arXiv: Machine Learning (cs.LG) ; Statistical Finance (q-fin.ST); Machine Learning (stat.ML).
Pagina del lavoro: https://arxiv.org/abs/2609.29530 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T04:50:39.441Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-25?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).