Metraipolis › archive › dc_8cd5a2f0a40a

Reference-Based Analysis of Coherence and Diversity in Open-Ended Text Generation — arXiv:2609.28080

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.28080
License (as archived)
CC0-1.0
Archived
2026-10-08T10:05:13.122Z
SHA-256 of the archived text
3ef986f90a0fea6bff3220faa14344995bdd409c88e32e34648b7ab43c9c2ec6
Stable URL of this page
https://metraipolis.com/documento/dc_8cd5a2f0a40a

How to cite

Reference-Based Analysis of Coherence and Diversity in Open-Ended Text Generation — arXiv:2609.28080 — arXiv (en), https://arxiv.org/abs/2609.28080 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_8cd5a2f0a40a (Metraipolis archive dc_8cd5a2f0a40a, sha256 3ef986f90a0fea6bff3220faa14344995bdd409c88e32e34648b7ab43c9c2ec6)
BibTeX
@misc{dc8cd5a2f0a40a,
  title = {Reference-Based Analysis of Coherence and Diversity in Open-Ended Text Generation — arXiv:2609.28080},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.28080},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_8cd5a2f0a40a; sha256 3ef986f90a0fea6bff3220faa14344995bdd409c88e32e34648b7ab43c9c2ec6},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.28080. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Evaluating open-ended text generation involves understanding how different properties of a continuation relate to its perceived quality. We present a reference-based framework for examining coherence and diversity through three perspectives: aligning their evolution with human trajectories, comparing their summaries with a human continuation of the same prompt, and estimating their likelihood under a human reference distribution. Experiments with human quality ratings suggest that diversity-based alignment and mean-based comparisons capture quality-related variation, although the comparisons do not establish a predictive advantage for temporal alignment over simpler baselines. Reference likelihood also shows positive associations with ratings, with results varying across reference configurations and scoring horizons. Together, these analyses provide a structured way to examine how measured coherence and diversity relate to human judgments, while distinguishing similarity to human references from quality itself. Code and analysis resources are available at this https URL .

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-24 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2609.28080 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T09:11:49.651Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-24?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).