Metraipolis › archive › dc_b8eeb894a2aa

FinForesight: A Diagnostic Backtesting Benchmark for Deep Research Systems in Financial Forecasting — arXiv:2611.01621

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.01621
License (as archived)
CC0-1.0
Archived
2026-11-03T18:22:53.658Z
SHA-256 of the archived text
c951e4dfb3ad5de0553dc59bc4bd2640419a81324175c62358b804036574b6a2
Stable URL of this page
https://metraipolis.com/documento/dc_b8eeb894a2aa

How to cite

FinForesight: A Diagnostic Backtesting Benchmark for Deep Research Systems in Financial Forecasting — arXiv:2611.01621 — arXiv (en), https://arxiv.org/abs/2611.01621 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_b8eeb894a2aa (Metraipolis archive dc_b8eeb894a2aa, sha256 c951e4dfb3ad5de0553dc59bc4bd2640419a81324175c62358b804036574b6a2)
BibTeX
@misc{dcb8eeb894a2aa,
  title = {FinForesight: A Diagnostic Backtesting Benchmark for Deep Research Systems in Financial Forecasting — arXiv:2611.01621},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.01621},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_b8eeb894a2aa; sha256 c951e4dfb3ad5de0553dc59bc4bd2640419a81324175c62358b804036574b6a2},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.01621. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Anticipating financial outcomes requires synthesizing evolving evidence and reasoning under uncertainty, making deep research systems promising tools for forecasting. Yet evaluating forecasting ability is challenging because historical backtests may reward memorized outcomes or information retrieved after the forecast date. Live forecasting avoids direct access to realized outcomes, but feedback arrives only after events resolve. To obtain timely feedback and assess historical scores, we introduce FinForesight, a diagnostic backtesting benchmark for financial deep research systems. Across the Chinese, U.S., and Hong Kong markets, the benchmark evaluates four forecasting tasks: valuation, return ranking, event direction, and future financial fundamentals. Two capability diagnostic tasks assess counterfactual reasoning and financial calculation, scored separately from forecasting performance. Our harness-compatible framework restricts retrieved evidence to information available at the forecast date. We compare pretraining-era, resolved post-cutoff, and live evaluations to test whether controlled backtests approximate future performance. Pretraining-era scores exceed post-cutoff scores in most temporal comparisons, and stronger retrieval controls narrow the gap between post-cutoff backtests and live results. Forecasting attribution and robustness analyses reveal how scores respond to retrieval policy and how predictions respond to prompt rewrites and numerical perturbations. The code and benchmark data are publicly available.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.CL, nuovi lavori del giorno).
Categorie arXiv: Computation and Language (cs.CL) ; Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2611.01621 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T18:10:07.934Z dalla pagina https://arxiv.org/list/cs.CL/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).