Metraipolis › archive › dc_323a92d52bf1

Not All Information Is Worth Asking For: Decision-Informed Information Seeking with LLMs — arXiv:2610.32181

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.32181
License (as archived)
CC0-1.0
Archived
2026-10-26T19:47:44.705Z
SHA-256 of the archived text
a0e41c315a7a962ab1311e65b54c915a77dd3256d9f40ef96c4e0e144d9f56e0
Stable URL of this page
https://metraipolis.com/documento/dc_323a92d52bf1

How to cite

Not All Information Is Worth Asking For: Decision-Informed Information Seeking with LLMs — arXiv:2610.32181 — arXiv (en), https://arxiv.org/abs/2610.32181 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_323a92d52bf1 (Metraipolis archive dc_323a92d52bf1, sha256 a0e41c315a7a962ab1311e65b54c915a77dd3256d9f40ef96c4e0e144d9f56e0)
BibTeX
@misc{dc323a92d52bf1,
  title = {Not All Information Is Worth Asking For: Decision-Informed Information Seeking with LLMs — arXiv:2610.32181},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.32181},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_323a92d52bf1; sha256 a0e41c315a7a962ab1311e65b54c915a77dd3256d9f40ef96c4e0e144d9f56e0},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.32181. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large language models (LLMs) are increasingly used to support decisions under incomplete information, where deciding what to look up and when to stop matters as much as the final answer. However, LLMs fall into an information trap: They pay for checks, i.e., costly pieces of evidence, that cannot change their decision or are not worth their cost, and they keep asking when the evidence is already sufficient. To this end, we propose Decision-Informed Value-of-information Acquisition (DIVA), a simple yet effective procedure for LLM information seeking based on the decision value of evidence. DIVA 1) lets the LLM specify a small decision model, i.e., how likely a bad outcome is and how each check would shift this probability, through short numeric questions and 2) values each candidate check by how much its imagined outcomes improve the decision net of its cost, stopping when no check is worth its cost. Its variant, DIVA-U, further accounts for the LLM's uncertain estimates of how strongly each check shifts this probability. DIVA is training-free and applies to any LLM. Across four domains and 20 LLMs, DIVA-U has lower regret, i.e., value lost relative to the best possible decision, than every LLM baseline on real-world data, mainly by stopping once evidence suffices, and DIVA cuts the regret of the best LLM baseline by 75% in synthetic scenarios where every check's reliability is given. Code: this http URL .

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Computation and Language (cs.CL); Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2610.32181 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-26T19:45:33.289Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).