Metraipolis › archive › dc_d1cd4cdb928b

DuSE-Bench: Benchmarking Joint Reasoning over Evolving Dialogue and Documents — arXiv:2611.00755

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.00755
License (as archived)
CC0-1.0
Archived
2026-11-03T18:22:39.862Z
SHA-256 of the archived text
2387330a832692931fd5c45cbb7e451d98bbe145d16e5f0c8f0863776445b6b1
Stable URL of this page
https://metraipolis.com/documento/dc_d1cd4cdb928b

How to cite

DuSE-Bench: Benchmarking Joint Reasoning over Evolving Dialogue and Documents — arXiv:2611.00755 — arXiv (en), https://arxiv.org/abs/2611.00755 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d1cd4cdb928b (Metraipolis archive dc_d1cd4cdb928b, sha256 2387330a832692931fd5c45cbb7e451d98bbe145d16e5f0c8f0863776445b6b1)
BibTeX
@misc{dcd1cd4cdb928b,
  title = {DuSE-Bench: Benchmarking Joint Reasoning over Evolving Dialogue and Documents — arXiv:2611.00755},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.00755},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d1cd4cdb928b; sha256 2387330a832692931fd5c45cbb7e451d98bbe145d16e5f0c8f0863776445b6b1},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.00755. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Persistent Web information assistants must combine evolving document facts with user requirements established and revised across sessions. Yet systematic evaluation of how changes in both sources affect response requirements and evidence attribution remains limited. To address this gap, we introduce Dual-Source Evolution Benchmark (DuSE-Bench), a benchmark comprising 1,000 tasks across five scenarios, including 700 whose required premises originate in both dialogue and documents. An evolving Support Graph guides task construction and preserves links from updated facts and reused conclusions to original turns and passages. Task annotations distinguish grounding source from state dependence and enable separate evaluation of response content, response type, and source attribution. Experiments across 11 baseline configurations reveal persistent challenges in joint reasoning over evolving dialogue and documents, with content accuracy on jointly grounded tasks reaching at most 56.7%. Moreover, improvements in content accuracy can coincide with poorer response choice, while content-correct responses frequently lack complete attribution to original evidence. Matched evidence substitutions further show that the effect of replacing one source's evidence depends on support from the other. These findings motivate coordinating dialogue memory and document retrieval to apply current user requirements and document facts together while preserving their original support. The data are available at this https URL .

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.CL, nuovi lavori del giorno).
Categorie arXiv: Computation and Language (cs.CL) ; Information Retrieval (cs.IR).
Pagina del lavoro: https://arxiv.org/abs/2611.00755 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T18:10:07.899Z dalla pagina https://arxiv.org/list/cs.CL/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).