Metraipolis › archive › dc_576cc476a61c

When Readability and Source Retention Diverge: An Evaluability Gap in AI Translation — arXiv:2608.19083

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.19083
License (as archived)
CC0-1.0
Archived
2026-10-18T13:52:29.460Z
SHA-256 of the archived text
9dd1021254bf793eadb0e80d3bb4641f23efd1fd11526753d1794a7ee9f9b56d
Stable URL of this page
https://metraipolis.com/documento/dc_576cc476a61c

How to cite

When Readability and Source Retention Diverge: An Evaluability Gap in AI Translation — arXiv:2608.19083 — arXiv (en), https://arxiv.org/abs/2608.19083 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_576cc476a61c (Metraipolis archive dc_576cc476a61c, sha256 9dd1021254bf793eadb0e80d3bb4641f23efd1fd11526753d1794a7ee9f9b56d)
BibTeX
@misc{dc576cc476a61c,
  title = {When Readability and Source Retention Diverge: An Evaluability Gap in AI Translation — arXiv:2608.19083},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.19083},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_576cc476a61c; sha256 9dd1021254bf793eadb0e80d3bb4641f23efd1fd11526753d1794a7ee9f9b56d},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.19083. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Readable AI output can leave an evaluability gap: even when the source is shown, an overall-quality judgment may not reflect what an output preserves. We investigated how source-text condition and output rendering relate to perceived translation quality, and how output and system appraisals relate to trust and stated disclosure willingness in a plain-text interface. A focal 2 * 2 comparison (N=306) using TransLingo examined simple generated narratives and complex literary-philosophical prose alongside LLM-generated readability-oriented outputs and researcher-revised fidelity-oriented outputs. A descriptive stimulus audit indicated greater source retention in fidelity-oriented outputs in both source-text conditions. Factorial analyses showed a significant rendering-by-source-text-condition interaction in perceived quality. Participants rated fidelity-oriented outputs higher than readability-oriented outputs for the simple narratives, whereas no reliable rendering difference emerged for the complex prose. A corresponding source-condition-dependent pattern was observed for perceived intelligence, agency-oriented anthropomorphic attribution, and task-performance trust. A separate theory-ordered appraisal-structure SEM characterized concurrent associations among perceived quality, perceived intelligence, agency-oriented anthropomorphic attribution, task-performance trust, and stated disclosure willingness across six domains, with task-performance trust as the proximal correlate of stated willingness. The observed rating pattern distinguishes source access from source evaluability: for the complex stimuli, displaying the source did not ensure that one overall-quality rating reflected differences in retained content. It also separates support for evaluating translation output from data-handling support for decisions about what personal text to entrust to a system.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-20 in cs.HC).
Categorie arXiv: Human-Computer Interaction (cs.HC) ; Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2608.19083 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T13:50:23.965Z dalla pagina https://arxiv.org/catchup/cs.HC/2026-08-20?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).