Metraipolis › archive › dc_e1d8f4eea478

LEAP: Likelihood Elicitation and Aggregation for LLM-based Probabilistic Forecasting — arXiv:2609.01337

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.01337
License (as archived)
CC0-1.0
Archived
2026-10-17T06:32:26.433Z
SHA-256 of the archived text
3c2913288b64f3e3e4d094825af91c1dc144b378a4bcb7246e624f326a053186
Stable URL of this page
https://metraipolis.com/documento/dc_e1d8f4eea478

How to cite

LEAP: Likelihood Elicitation and Aggregation for LLM-based Probabilistic Forecasting — arXiv:2609.01337 — arXiv (en), https://arxiv.org/abs/2609.01337 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e1d8f4eea478 (Metraipolis archive dc_e1d8f4eea478, sha256 3c2913288b64f3e3e4d094825af91c1dc144b378a4bcb7246e624f326a053186)
BibTeX
@misc{dce1d8f4eea478,
  title = {LEAP: Likelihood Elicitation and Aggregation for LLM-based Probabilistic Forecasting — arXiv:2609.01337},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.01337},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e1d8f4eea478; sha256 3c2913288b64f3e3e4d094825af91c1dc144b378a4bcb7246e624f326a053186},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.01337. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

LLM-based forecasting systems have improved on real-world tasks such as financial markets and sports outcomes, largely through stronger search and tool use. Many systems still ask an LLM to read all collected evidence together and produce the final forecast. We call this design Monolithic Prediction. It can obscure how individual evidence items affect the result and collapse uncertainty across competing outcomes. We propose LEAP (Likelihood Elicitation and Aggregation for Probabilistic forecasting), which reorganizes how collected evidence is used in the prediction stage. LEAP examines each evidence item separately and elicits likelihood parameters that describe its implications for the target. An explicit prior and a deterministic probabilistic model then combine these likelihoods into a posterior distribution. This procedure supports continuous, single-choice, and multi-choice forecasts while preserving reproducible evidence contributions. We build a benchmark covering forecasting, information-seeking, and browsing tasks, and evaluate LEAP on our own agent loop and several agent CLI frameworks. Given the same evidence, LEAP improves most prediction and calibration metrics across models and remains stronger under controlled comparisons of prior access, inference budget, and aggregation.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-02 in cs.AI).
Categorie arXiv: Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2609.01337 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T06:15:12.689Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-02?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).