Metraipolis › archive › dc_7ba3d33af683
Too Good to Be Real? Diagnosing and Reducing the Gap Between AI Preference and Real User Engagement — arXiv:2609.18282
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.18282
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-15T13:49:24.154Z
- SHA-256 of the archived text
6cfd751f4486974b76e37e140564dd62b94568902d339090568d480f55d98fa7- Stable URL of this page
https://metraipolis.com/documento/dc_7ba3d33af683
How to cite
Too Good to Be Real? Diagnosing and Reducing the Gap Between AI Preference and Real User Engagement — arXiv:2609.18282 — arXiv (en), https://arxiv.org/abs/2609.18282 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_7ba3d33af683 (Metraipolis archive dc_7ba3d33af683, sha256 6cfd751f4486974b76e37e140564dd62b94568902d339090568d480f55d98fa7)
BibTeX
@misc{dc7ba3d33af683,
title = {Too Good to Be Real? Diagnosing and Reducing the Gap Between AI Preference and Real User Engagement — arXiv:2609.18282},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.18282},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_7ba3d33af683; sha256 6cfd751f4486974b76e37e140564dd62b94568902d339090568d480f55d98fa7},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.18282. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Large language models are increasingly used to generate and evaluate online content, yet it remains unclear whether the qualities they associate with higher engagement match what real users respond to. We study this question using 1.17 million answers to 25,978 questions from Zhihu, Quora, and Reddit, comparing real platform answers and AI-generated answers across four within-question engagement levels. We introduce Ontological Preference Measurement, which represents answers along three dimensions: logic, affect, and expression. We find a systematic gap between AI preference and real user engagement: as target engagement increases, LLMs add more explicit logical structure, while real user engagement is more strongly associated with affective and expressive salience. We call this tendency logic overbinding. Based on this diagnosis, we propose Ontology-Masked Reasoning Autoencoding (OMRA), a controlled intervention that masks and reconstructs over-explained spans while preserving stance, factual content, and coherence. Across four LLM families, OMRA reduces the measured gap by an average of 54.4%. In human evaluation, OMRA wins 62.4% of pairwise preference judgments against matched real platform answers, even though the real answers are more often judged to be human-written. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-17 in cs.CL). Categorie arXiv: Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2609.18282 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-15T13:48:24.309Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-17?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).