Metraipolis › archive › dc_89ecad2fd31e

Signals, Evidence, and Context: User Scrutiny in Real-World LLM Conversations — arXiv:2611.08232

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.08232
License (as archived)
CC0-1.0
Archived
2026-11-06T14:41:55.186Z
SHA-256 of the archived text
9b07baa1c0b9d8c8e2e8e378a20f0d99fac7548c87853a86907e041105fbd79c
Stable URL of this page
https://metraipolis.com/documento/dc_89ecad2fd31e

How to cite

Signals, Evidence, and Context: User Scrutiny in Real-World LLM Conversations — arXiv:2611.08232 — arXiv (en), https://arxiv.org/abs/2611.08232 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_89ecad2fd31e (Metraipolis archive dc_89ecad2fd31e, sha256 9b07baa1c0b9d8c8e2e8e378a20f0d99fac7548c87853a86907e041105fbd79c)
BibTeX
@misc{dc89ecad2fd31e,
  title = {Signals, Evidence, and Context: User Scrutiny in Real-World LLM Conversations — arXiv:2611.08232},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.08232},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_89ecad2fd31e; sha256 9b07baa1c0b9d8c8e2e8e378a20f0d99fac7548c87853a86907e041105fbd79c},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.08232. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large language models (LLMs) often present synthesized answers without making their supporting evidence easy to inspect. We study how features of these answers relate to users' subsequent accepting, checking, and challenging in 489,283 assistant-user response pairs from ShareChat and WildChat. Broad attribution language appears in 31.9% of qualifying responses, compared with explicit URLs in 1.33%, revealing a gap between claims of grounding and preserved inspectable support. Attribution, uncertainty, and other response cues generally accompany both checking and challenging; only uncertainty shows a small statistically distinguishable pooled association favoring checking. Within Technical Help, uncertainty favors checking relative to challenging; refusals and reasoning traces favor challenging in Seeking Information. Scrutiny is concentrated in some conversations, while its apparent turn-to-turn persistence becomes much smaller when conversation-level differences and response ordering are examined separately. These results suggest that supporting verification requires attention to what evidence can be inspected, which question a user is trying to resolve, and the history of the interaction.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2611.08232 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-06T14:18:42.653Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).