Metraipolis › archive › dc_07bc3ce4324b
Probability Contracts: Accuracy, Coherence, and Decisions Across LLM Interfaces — arXiv:2609.37470
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.37470
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T17:31:23.596Z
- SHA-256 of the archived text
ccabd9870bbc27c828956d9ecb04db93311b89fab256060cc28b3e1f31ca97a9- Stable URL of this page
https://metraipolis.com/documento/dc_07bc3ce4324b
How to cite
Probability Contracts: Accuracy, Coherence, and Decisions Across LLM Interfaces — arXiv:2609.37470 — arXiv (en), https://arxiv.org/abs/2609.37470 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_07bc3ce4324b (Metraipolis archive dc_07bc3ce4324b, sha256 ccabd9870bbc27c828956d9ecb04db93311b89fab256060cc28b3e1f31ca97a9)
BibTeX
@misc{dc07bc3ce4324b,
title = {Probability Contracts: Accuracy, Coherence, and Decisions Across LLM Interfaces — arXiv:2609.37470},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.37470},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_07bc3ce4324b; sha256 ccabd9870bbc27c828956d9ecb04db93311b89fab256060cc28b3e1f31ca97a9},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.37470. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Equivalent probability requests can lead to different decisions even when both reports are valid. We introduce probability contracts, a benchmark that connects exact finite-world posteriors, validated event alignment, interface coherence, and failure-aware decision evaluation. Across four model-interface configurations on 1,000 worlds, Kev has lower aggregate canonical posterior error than Jev but larger complement and coarsening residuals; accuracy ordering varies by stratum. Jev's Event and Choice interfaces change the binary action on 32.8% of valid pairs at defer cost 0.10. Post-hoc analyses show that disagreement certifies only 11-52% of mean binary pair error and does not consistently outperform confidence for selection. An action-region characterization and a standard scoring-rule identity explain averaging's expected Brier guarantee relative to random interface selection, but not a decision-loss guarantee at each cost. The loss contrast takes both signs on a 99-cost grid for every configuration; small penalties where both policies beat deferral have pointwise intervals containing zero. Secondary checks specified before collection include a separate 400-root cohort, where Event/Choice effects remain configuration-dependent. A joint surface-order and answer-ID intervention shifts posttrained probabilities. Both bounded reasoning arms yield no valid probability reports, leaving their probability accuracy undefined. Probability contracts make these distinctions measurable by evaluating event semantics, posterior error, coverage, and decision cost together. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-30 in cs.LG). Categorie arXiv: Machine Learning (cs.LG) ; Machine Learning (stat.ML). Pagina del lavoro: https://arxiv.org/abs/2609.37470 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T16:59:48.333Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-30?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).