Metraipolis › archive › dc_4ff63c0d77b4
Is This Your Final Answer? Cross-Contextual Consistency as a Measure of LLM Credibility — arXiv:2608.10315
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.10315
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T06:09:01.781Z
- SHA-256 of the archived text
e8b2687e548822b91bbb5acd30590870f24b81ee2af22cc97b5cec7dc8e597dd- Stable URL of this page
https://metraipolis.com/documento/dc_4ff63c0d77b4
How to cite
Is This Your Final Answer? Cross-Contextual Consistency as a Measure of LLM Credibility — arXiv:2608.10315 — arXiv (en), https://arxiv.org/abs/2608.10315 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_4ff63c0d77b4 (Metraipolis archive dc_4ff63c0d77b4, sha256 e8b2687e548822b91bbb5acd30590870f24b81ee2af22cc97b5cec7dc8e597dd)
BibTeX
@misc{dc4ff63c0d77b4,
title = {Is This Your Final Answer? Cross-Contextual Consistency as a Measure of LLM Credibility — arXiv:2608.10315},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.10315},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_4ff63c0d77b4; sha256 e8b2687e548822b91bbb5acd30590870f24b81ee2af22cc97b5cec7dc8e597dd},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.10315. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Large language models (LLMs) are powerful black-box systems, making it difficult to discern whether their answers reflect stable internal beliefs or superficial pattern matching. We identify cross-contextual consistency as an underutilized behavioral property of LLMs: a credible answer should remain stable when the same task is placed under topic-aligned, content-neutral contextual variation. Building on this intuition, we operationalize Cross-Contextual Consistency (C3) by comparing model generations under original and perturbed prompts. Across 26 models and six benchmarks spanning reasoning, factuality, and code generation, we find that answers with smaller cross-contextual shifts are more likely to be correct or factual. We demonstrate that C3 provides a complementary axis of evaluation and can serve as a benchmark usefulness diagnostic, identifying which portions of a benchmark remain informative even when aggregated scores are widely considered "saturate". Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-12 in cs.AI). Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2608.10315 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T05:57:28.349Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-12?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).