Metraipolis › archive › dc_3f7cfee78982

More Claims, Less Evidence: Bounded Verification of AI-Generated Digital Knowledge Artifacts — arXiv:2610.05547

Source
arXiv
Original
https://arxiv.org/abs/2610.05547
License (as archived)
CC0-1.0
Archived
2026-10-06T05:25:14.784Z
SHA-256 of the archived text
6c22d9a459424a7f747c95380991d0ca7a27fb8a6f16ab969d4347a220e0be62
Stable URL of this page
https://metraipolis.com/documento/dc_3f7cfee78982

How to cite

More Claims, Less Evidence: Bounded Verification of AI-Generated Digital Knowledge Artifacts — arXiv:2610.05547 — arXiv, https://arxiv.org/abs/2610.05547 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_3f7cfee78982 (Metraipolis archive dc_3f7cfee78982, sha256 6c22d9a459424a7f747c95380991d0ca7a27fb8a6f16ab969d4347a220e0be62)
BibTeX
@misc{dc3f7cfee78982,
  title = {More Claims, Less Evidence: Bounded Verification of AI-Generated Digital Knowledge Artifacts — arXiv:2610.05547},
  howpublished = {arXiv},
  url = {https://arxiv.org/abs/2610.05547},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_3f7cfee78982; sha256 6c22d9a459424a7f747c95380991d0ca7a27fb8a6f16ab969d4347a220e0be62},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv, https://arxiv.org/abs/2610.05547. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Digital libraries, repositories, and AI-mediated knowledge services increasingly rely on generative systems to produce summaries, descriptions, and other multi-claim knowledge objects. Yet generation can scale far more easily than verification capacity: a reviewer may need to decide whether an object is suitable for publication or downstream use after checking only a small fraction of its claims. This creates a fundamental gap between claim-level verification and confidence in the object as a whole. The central question is therefore what a successful partial check implies about the reliability of the complete artifact when its size grows but the verification budget does not. This paper contributes a Bayesian model of bounded verification centered on the Predictive Value of Pass (PVP). The model predicts that evidentiary value decreases as artifacts grow under fixed verification capacity, improves with larger verification budgets, and is especially fragile when errors are sparse. Controlled experiments on FEVEROUS and FEVER support these predictions and show that adding supported claims around a fixed number of false or unsupported claims can make passing more likely while making a pass less informative. The model further yields the minimum verification budget required to maintain a target PVP, providing a practical component for AI-assisted quality-assurance workflows in which generated knowledge objects must be checked before publication or downstream use.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Digital Libraries (cs.DL).
Pagina del lavoro: https://arxiv.org/abs/2610.05547 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-06T05:24:05.606Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).